00000001:02000400:0.0F:1788831901.675372:0:3306:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788831915.571179:0:3528:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1788831917.395816:0:3589:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 563 MB/s 00000001:01000000:2.0:1788831917.646203:0:3589:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 751 MB/s 00000001:01000000:3.0:1788831917.895961:0:3589:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4027 MB/s 00000020:02000000:0.0:1788831918.559972:0:3620:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_110_g063755c 00000400:02000000:1.0F:1788831919.542779:0:3635:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.126@tcp [8/256/0/180] 00008000:02000000:1.0:1788831923.085544:0:3785:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788831987.517404:0:5752:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788832002.336273:0:6502:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788832002.336283:0:6502:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788832002.336285:0:6502:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788832002.336440:0:6502:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000021a28252 00000080:02000400:3.0:1788832002.336455:0:6502:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788832002.346575:0:6502:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788832002.346597:0:6502:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788832002.347497:0:6502:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000282388ff) 00000020:00000080:2.0:1788832002.347528:0:6502:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788832002.424173:0:6502:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788832002.425031:0:6502:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1788832002.463570:0:6502:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788832002.464307:0:6502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788832002.464318:0:6502:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788832002.464333:0:6502:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x998c12b283536aa0 00000020:01000004:3.0:1788832002.464344:0:6502:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788832002.464350:0:6502:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788832002.464355:0:6502:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000021a28252 from MGS 00000020:01000004:3.0:1788832002.464362:0:6502:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788832002.464386:0:6502:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000002f5c092c) 00000020:00000080:3.0:1788832002.464400:0:6502:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788832002.464595:0:6502:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000021a28252 from MGS, refs=2 00080000:01000000:3.0:1788832002.464602:0:6502:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788832002.464607:0:6502:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x998c12b283536aae 00000100:00100000:3.0:1788832002.465130:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788832002.465350:0:6502:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788832002.465356:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788832002.470118:0:6502:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788832002.470139:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788832002.471601:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788832002.472425:0:6502:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788832002.472434:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788832002.476591:0:6502:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788832002.476612:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788832002.477387:0:6502:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788832002.477396:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788832002.478867:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832002.478874:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832002.478876:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832002.479373:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832002.479376:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832002.479377:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832002.480196:0:6502:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788832002.484195:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1788832002.730446:0:6502:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2919 MB/s 00000001:01000000:2.0:1788832002.979778:0:6502:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2855 MB/s 00000001:01000000:0.0:1788832003.233207:0:6502:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 541 MB/s 00000001:01000000:1.0:1788832003.482823:0:6502:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 471 MB/s 00080000:10000000:1.0:1788832003.497108:0:6502:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:0.0:1788832003.528179:0:6502:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788832003.529273:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788832003.529395:0:6502:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788832003.529457:0:6502:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788832003.529685:0:6502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788832003.529847:0:6502:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788832003.530368:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788832003.530558:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788832003.530565:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788832003.532587:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788832003.532603:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788832003.536405:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788832003.536424:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1788832003.542450:0:6521:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788832003.543024:0:6502:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788832003.543055:0:6502:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.126@tcp' 00000020:01000004:2.0:1788832003.543058:0:6502:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788832003.543132:0:6502:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.126@tcp (typ=mgc) 00000020:00000080:2.0:1788832003.543149:0:6502:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.126@tcp (000000005da1a0b3) 00000020:00000080:2.0:1788832003.543170:0:6502:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788832003.543289:0:6502:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000033c0772c@MGC192.168.203.126@tcp: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1788832003.543464:0:6502:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.126@tcp-0 is initialized 00000040:01000000:2.0:1788832003.543472:0:6502:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 1 is initialized 00010000:00010000:1.0:1788832003.544126:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788832003.552291:0:6522:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788832003.552378:0:6502:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.126@tcp (uuid e55f0905-9d39-4464-9830-326b420fb582) 00000020:00000080:1.0:1788832003.552410:0:6502:0:(genops.c:1385:class_connect()) connect: client e55f0905-9d39-4464-9830-326b420fb582, cookie 0x998c12b283536abc 00000100:00080000:1.0:1788832003.552426:0:6502:0:(import.c:510:import_select_connection()) MGC192.168.203.126@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788832003.552432:0:6502:0:(import.c:624:import_select_connection()) MGC192.168.203.126@tcp: import 0000000033c0772c using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788832003.552498:0:6502:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000873c19a9 x1875726218297472/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788832003.552532:0:6502:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e55f0905-9d39-4464-9830-326b420fb582->MGS 00000020:01000004:1.0:1788832003.552554:0:6502:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788832003.552585:0:6502:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788832003.552612:0:6502:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000d071f48a) 00000020:00000080:1.0:1788832003.552654:0:6502:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788832003.553142:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000873c19a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e55f0905-9d39-4464-9830-326b420fb582:3650:1875726218297472:0@lo:250: 00000100:00100000:3.0:1788832003.553276:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832003.572536:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218297472 00000100:00100000:3.0:1788832003.572569:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218297472 00000100:00100000:3.0:1788832003.572663:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788832003.572672:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000536a99b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3650:x1875726218297472:12345-0@lo:250: 00010000:00080000:3.0:1788832003.572729:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e55f0905-9d39-4464-9830-326b420fb582@0@lo t0 exp 0000000000000000 cur 143 last 0 00000020:00000080:3.0:1788832003.572767:0:6518:0:(genops.c:1385:class_connect()) connect: client e55f0905-9d39-4464-9830-326b420fb582, cookie 0x998c12b283536aca 00000100:00080000:3.0:1788832003.574097:0:6518:0:(import.c:65:import_set_state_nolock()) 00000000e64f9084 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788832003.574233:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000536a99b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+5:3650:x1875726218297472:12345-0@lo:250: Request processed in 1559us (20955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832003.574244:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788832003.576006:0:3650:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.126@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788832003.576030:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.126@tcp: connect to target with instance 0 00000100:00080000:2.0:1788832003.576043:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788832003.576050:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788832003.576055:0:3650:0:(import.c:65:import_set_state_nolock()) 0000000033c0772c MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788832003.576059:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788832003.576063:0:3650:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788832003.576073:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000873c19a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e55f0905-9d39-4464-9830-326b420fb582:3650:1875726218297472:0@lo:250: 00000100:00100000:1.0:1788832003.580119:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788832003.580393:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788832003.580401:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788832003.581565:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788832003.581577:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788832003.583178:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788832003.583193:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788832003.586244:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788832003.587059:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788832003.587068:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788832003.591740:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788832003.591759:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788832003.638827:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788832003.639136:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788832003.639145:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788832003.643440:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788832003.643459:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788832003.648065:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788832003.648382:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788832003.648390:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788832003.649319:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788832003.649336:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788832003.650042:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788832003.650310:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788832003.650316:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788832003.651111:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788832003.651119:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788832003.652024:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788832003.652279:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788832003.652288:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788832003.653000:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788832003.653015:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788832003.681743:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788832003.682323:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788832003.682331:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788832003.684424:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788832003.684443:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788832003.688860:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788832003.688882:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788832003.690152:0:6502:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788832003.690324:0:6502:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788832003.690334:0:6502:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788832003.690486:0:6502:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788832003.690534:0:6502:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.126@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788832003.690540:0:6502:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788832003.690542:0:6502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788832003.690543:0:6502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788832003.690544:0:6502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788832003.690545:0:6502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788832003.690552:0:6502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788832003.690553:0:6502:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788832003.690554:0:6502:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788832003.690556:0:6502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788832003.690557:0:6502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788832003.690559:0:6502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788832003.690560:0:6502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788832003.690563:0:6502:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788832003.690565:0:6502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788832003.690566:0:6502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788832003.690567:0:6502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788832003.690567:0:6502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788832003.690568:0:6502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788832003.690569:0:6502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788832003.690569:0:6502:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788832003.690570:0:6502:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788832003.690571:0:6502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788832003.690572:0:6502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788832003.690572:0:6502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788832003.690573:0:6502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788832003.690617:0:6502:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788832003.690991:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f89b2727 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218297600:0@lo:253: 00000100:00100000:3.0:1788832003.691098:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832003.691276:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 0000000011c545ae going to sleep for 11 seconds 00000100:00100000:2.0:1788832003.691462:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218297600 00000100:00100000:2.0:1788832003.691472:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218297600 00000100:00100000:2.0:1788832003.691536:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788832003.691545:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5cb22a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+5:6502:x1875726218297600:12345-0@lo:253: 20000000:01000000:2.0:1788832003.691611:0:6519:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788832003.691614:0:6519:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788832003.692148:0:6541:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788832003.692329:0:6519:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788832003.692753:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788832003.703967:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788832003.704483:0:6519:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788832003.704489:0:6519:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788832003.704498:0:6519:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788832003.704501:0:6519:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788832003.704516:0:6519:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788832003.705412:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788832003.706141:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788832003.706164:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788832003.706321:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788832003.706343:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788832003.706358:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788832003.706445:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788832003.706453:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788832003.706466:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788832003.706472:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788832003.706482:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788832003.706486:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788832003.706497:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788832003.706509:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788832003.706535:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788832003.706541:0:6519:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788832003.706548:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788832003.706916:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788832003.706935:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788832003.706953:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788832003.706968:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788832003.706983:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788832003.706993:0:6519:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788832003.707023:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788832003.707030:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788832003.707059:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788832003.707076:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788832003.707103:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788832003.707113:0:6519:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788832003.707137:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788832003.707145:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788832003.707155:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788832003.707169:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788832003.707362:0:6519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788832003.707384:0:6519:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788832003.707392:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788832003.708008:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788832003.708370:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788832003.708401:0:6519:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.126@tcp for mdt 20000000:01000000:0.0:1788832003.708403:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:0.0:1788832003.708418:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788832003.708423:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788832003.708434:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788832003.708439:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:0.0:1788832003.708449:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788832003.708456:0:6519:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788832003.708468:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788832003.708480:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788832003.708508:0:6519:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788832003.708512:0:6519:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788832003.708525:0:6519:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788832003.708574:0:6519:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788832003.708577:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788832003.716038:0:6544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788832003.716585:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788832003.716800:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788832003.716943:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1788832003.716958:0:6519:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788832003.716961:0:6519:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788832003.720179:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788832003.720739:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788832003.720807:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788832003.720825:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1788832003.720842:0:6519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788832003.720845:0:6519:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788832003.720852:0:6519:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788832003.720854:0:6519:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788832003.720862:0:6519:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788832003.720870:0:6519:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788832003.721499:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788832003.721689:0:6519:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788832003.737547:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788832003.737598:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788832003.737615:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788832003.737658:0:6519:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788832003.737700:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000022897c45/0x998c12b283536ad1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.737722:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000022897c45/0x998c12b283536ad1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.737734:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000022897c45/0x998c12b283536ad1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.737741:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000022897c45/0x998c12b283536ad1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.737748:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000022897c45/0x998c12b283536ad1 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.737755:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000022897c45/0x998c12b283536ad1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.737785:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000022897c45 already unused, calling callback (000000002a293869) 00010000:00010000:1.0:1788832003.737790:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000022897c45/0x998c12b283536ad1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.737797:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000022897c45/0x998c12b283536ad1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.737813:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000022897c45/0x998c12b283536ad1 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.737820:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000022897c45/0x998c12b283536ad1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.737826:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000022897c45/0x998c12b283536ad1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788832003.737847:0:6519:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788832003.746996:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5cb22a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+5:6502:x1875726218297600:12345-0@lo:253: Request processed in 55438us (55884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832003.747020:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788832003.747135:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f89b2727 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218297600:0@lo:253: 10000000:01000000:2.0:1788832003.747156:0:6502:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788832003.747160:0:6502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788832003.747162:0:6502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788832003.747163:0:6502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788832003.747164:0:6502:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788832003.747166:0:6502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788832003.747167:0:6502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788832003.747168:0:6502:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788832003.747170:0:6502:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788832003.747179:0:6502:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788832003.747181:0:6502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788832003.747182:0:6502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788832003.747207:0:6502:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000021a28252 from lustre-MDT0000 10000000:01000000:2.0:1788832003.747244:0:6502:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788832003.747247:0:6502:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788832003.747252:0:6502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9d2c18e319b8 10000000:01000000:2.0:1788832003.747257:0:6502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788832003.747266:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d2c18e319b8 from 1 10000000:01000000:2.0:1788832003.747269:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788832003.747331:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 000000002ef8c5da/0x998c12b283536ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832003.747343:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 000000002ef8c5da/0x998c12b283536ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832003.747354:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 000000002ef8c5da/0x998c12b283536ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832003.747377:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000011e37bac pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218297728:0@lo:101: 00000100:00100000:2.0:1788832003.748219:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832003.748288:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 00000000104943ad going to sleep for 11 seconds 00000100:00100000:0.0:1788832003.748455:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218297728 00000100:00100000:0.0:1788832003.748467:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218297728 00000100:00100000:0.0:1788832003.748541:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788832003.748551:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019263b21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+5:6502:x1875726218297728:12345-0@lo:101: 00010000:00010000:0.0:1788832003.748568:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832003.748589:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000091a2b1bd/0x998c12b283536adf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536ad8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832003.748647:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000091a2b1bd/0x998c12b283536adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536ad8 expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832003.748660:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000091a2b1bd/0x998c12b283536adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536ad8 expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832003.748675:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000091a2b1bd, rc 0) 00000100:00100000:0.0:1788832003.748721:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019263b21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+6:6502:x1875726218297728:12345-0@lo:101: Request processed in 173us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832003.748727:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788832003.749069:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000011e37bac pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218297728:0@lo:101: 00010000:00010000:1.0:1788832003.749098:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 000000002ef8c5da/0x998c12b283536ad8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536adf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.749109:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 000000002ef8c5da/0x998c12b283536ad8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536adf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832003.749198:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000067bb4518 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218297856:0@lo:501: 00000100:00100000:1.0:1788832003.749240:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832003.749275:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 000000009393b529 going to sleep for 11 seconds 00000100:00100000:2.0:1788832003.749326:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218297856 00000100:00100000:2.0:1788832003.749330:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218297856 00000100:00100000:2.0:1788832003.749396:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788832003.749402:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f69a5cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+6:6502:x1875726218297856:12345-0@lo:501: 00000100:00100000:2.0:1788832003.749494:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f69a5cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+6:6502:x1875726218297856:12345-0@lo:501: Request processed in 92us (253us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788832003.749501:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788832003.749555:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000067bb4518 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218297856:0@lo:501: 10000000:01000000:1.0:1788832003.749587:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788832003.749601:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 000000002ef8c5da/0x998c12b283536ad8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536adf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.749609:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 000000002ef8c5da/0x998c12b283536ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536adf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832003.749618:0:6502:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d2c40623800 10000000:01000000:1.0:1788832003.749652:0:6502:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788832003.749657:0:6502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d2c40623800 10000000:01000000:1.0:1788832003.749659:0:6502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788832003.749662:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9d2c40623800 from 1 10000000:01000000:1.0:1788832003.749664:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788832003.749687:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000be009b49/0x998c12b283536ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.749694:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000be009b49/0x998c12b283536ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.749702:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000be009b49/0x998c12b283536ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832003.749713:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000067bb4518 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218297984:0@lo:101: 00000100:00100000:1.0:1788832003.749738:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832003.750285:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 000000009393b529 going to sleep for 11 seconds 00000100:00100000:0.0:1788832003.752037:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218297984 00000100:00100000:0.0:1788832003.752055:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218297984 00000100:00100000:0.0:1788832003.752160:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788832003.752170:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004955e624 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+6:6502:x1875726218297984:12345-0@lo:101: 00010000:00010000:0.0:1788832003.752349:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832003.752378:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b3f086e1/0x998c12b283536aed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536ae6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832003.752414:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b3f086e1/0x998c12b283536aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536ae6 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832003.752428:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b3f086e1/0x998c12b283536aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536ae6 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832003.752438:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b3f086e1, rc 0) 00000100:00100000:0.0:1788832003.752554:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004955e624 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+7:6502:x1875726218297984:12345-0@lo:101: Request processed in 385us (2815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832003.752562:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788832003.753744:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000067bb4518 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218297984:0@lo:101: 00010000:00010000:1.0:1788832003.753802:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000be009b49/0x998c12b283536ae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536aed expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.753816:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000be009b49/0x998c12b283536ae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536aed expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832003.753840:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788832003.753854:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000be009b49/0x998c12b283536ae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536aed expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.753861:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000be009b49/0x998c12b283536ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536aed expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832003.753870:0:6502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788832003.753876:0:6502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788832003.753883:0:6502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d2c40623800 10000000:01000000:1.0:1788832003.753885:0:6502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788832003.753889:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788832003.753892:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788832003.753929:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 0000000022897c45/0x998c12b283536af4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.753936:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 0000000022897c45/0x998c12b283536af4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.753957:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 0000000022897c45/0x998c12b283536af4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832003.753981:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000067bb4518 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218298112:0@lo:101: 00000100:00100000:1.0:1788832003.754046:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832003.754119:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 000000009393b529 going to sleep for 11 seconds 00000100:00100000:1.0:1788832003.754145:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218298112 00000100:00100000:1.0:1788832003.754153:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218298112 00000100:00100000:1.0:1788832003.754213:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788832003.754224:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dffd3b90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+7:6502:x1875726218298112:12345-0@lo:101: 00010000:00010000:1.0:1788832003.754240:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832003.754255:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007837698b/0x998c12b283536afb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536af4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.754288:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007837698b/0x998c12b283536afb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536af4 expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.754298:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007837698b/0x998c12b283536afb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536af4 expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.754306:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007837698b, rc 0) 00000100:00100000:1.0:1788832003.754351:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dffd3b90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+8:6502:x1875726218298112:12345-0@lo:101: Request processed in 130us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832003.754358:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788832003.755227:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000067bb4518 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218298112:0@lo:101: 00010000:00010000:0.0:1788832003.755436:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 0000000022897c45/0x998c12b283536af4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536afb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832003.755447:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 0000000022897c45/0x998c12b283536af4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536afb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832003.755570:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bb693a8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218298240:0@lo:501: 00000100:00100000:0.0:1788832003.755767:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832003.755862:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6494ac7 going to sleep for 11 seconds 00000100:00100000:3.0:1788832003.757046:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218298240 00000100:00100000:3.0:1788832003.757059:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218298240 00000100:00100000:3.0:1788832003.757142:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788832003.757152:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe9ba1c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+8:6502:x1875726218298240:12345-0@lo:501: 00000100:00100000:3.0:1788832003.757352:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe9ba1c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+9:6502:x1875726218298240:12345-0@lo:501: Request processed in 201us (1586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832003.757360:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788832003.759412:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bb693a8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218298240:0@lo:501: 00000100:00100000:0.0:1788832003.759526:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bb693a8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218298368:0@lo:503: 00000100:00100000:0.0:1788832003.759612:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832003.759686:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6494ac7 going to sleep for 11 seconds 00000100:00100000:3.0:1788832003.759774:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218298368 00000100:00100000:3.0:1788832003.759790:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218298368 00000100:00100000:3.0:1788832003.759850:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788832003.759860:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f8ffa55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+9:6502:x1875726218298368:12345-0@lo:503: 00000100:00100000:3.0:1788832003.760005:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f8ffa55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+9:6502:x1875726218298368:12345-0@lo:503: Request processed in 146us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832003.760013:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788832003.760327:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bb693a8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218298368:0@lo:503: 00000100:00100000:3.0:1788832003.760818:0:6547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000095719a15 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:6547:1875726218298496:0@lo:502: 00000100:00100000:3.0:1788832003.760876:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832003.760904:0:6547:0:(client.c:2715:ptlrpc_set_wait()) set 0000000008a47b5d going to sleep for 11 seconds 00000100:00100000:0.0:1788832003.760973:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218298496 00000100:00100000:0.0:1788832003.760980:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218298496 00000100:00100000:0.0:1788832003.761011:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788832003.761017:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa96ab43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+9:6547:x1875726218298496:12345-0@lo:502: 00000100:00100000:0.0:1788832003.761173:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa96ab43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+9:6547:x1875726218298496:12345-0@lo:502: Request processed in 156us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832003.761181:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788832003.761450:0:6547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000095719a15 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:6547:1875726218298496:0@lo:502: 00000020:01000000:3.0:1788832003.761479:0:6547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832003.761493:0:6547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832003.761496:0:6547:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788832003.761501:0:6547:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788832003.761504:0:6547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788832003.761521:0:6547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000674245f6) 00000020:00000080:3.0:1788832003.761545:0:6547:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788832003.761552:0:6547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788832003.761729:0:6547:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788832003.761738:0:6547:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x998c12b283536b09 00000020:00000080:3.0:1788832003.762288:0:6547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788832003.762294:0:6547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832003.762299:0:6547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832003.762301:0:6547:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788832003.762303:0:6547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832003.762308:0:6547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832003.762309:0:6547:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788832003.762312:0:6547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788832003.762321:0:6547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000034e30280) 00000020:00000080:3.0:1788832003.762334:0:6547:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788832003.762345:0:6547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788832003.762347:0:6547:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788832003.762350:0:6547:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788832003.762357:0:6547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788832003.762412:0:6547:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000021a28252 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788832003.762428:0:6547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000009274a786) 00000020:00000080:3.0:1788832003.762437:0:6547:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788832003.762507:0:6547:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788832003.762514:0:6547:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x998c12b283536b1e 00000020:00000080:3.0:1788832003.762667:0:6547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788832003.762675:0:6547:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788832003.762680:0:6547:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x998c12b283536b25 00080000:01000000:3.0:1788832003.762686:0:6547:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788832003.762689:0:6547:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x998c12b283536b2c 00080000:10000000:2.0:1788832003.768484:0:6547:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788832003.770275:0:6547:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788832003.779893:0:6547:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788832003.899601:0:6547:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788832003.900035:0:6547:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788832003.905009:0:6547:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788832003.906175:0:6547:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788832003.913899:0:6547:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000004bf98371) 00000020:00000080:2.0:1788832003.913929:0:6547:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788832003.914025:0:6547:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788832003.914036:0:6547:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x998c12b283536b3a 00000020:00000080:2.0:1788832003.916244:0:6547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788832003.918815:0:6547:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1788832003.934344:0:6547:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1788832003.940512:0:6547:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1788832003.948139:0:6547:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1788832003.958553:0:6547:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1788832003.962590:0:6547:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1788832003.965477:0:6547:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x998c12b283536b41 00000020:00000080:1.0:1788832003.980507:0:6547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788832003.980530:0:6547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832003.980543:0:6547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832003.980547:0:6547:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788832003.980550:0:6547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832003.980555:0:6547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832003.980557:0:6547:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788832003.980560:0:6547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788832003.980562:0:6547:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788832003.980565:0:6547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832003.980567:0:6547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832003.980568:0:6547:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788832003.980592:0:6547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832003.980598:0:6547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832003.980599:0:6547:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788832003.980604:0:6547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788832003.980736:0:6547:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1788832003.981008:0:6547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001633581f pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:6547:1875726218298624:0@lo:502: 00000100:00100000:1.0:1788832003.981129:0:6547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832003.981193:0:6547:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1defbc4 going to sleep for 11 seconds 00000100:00100000:0.0:1788832003.981398:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218298624 00000100:00100000:0.0:1788832003.981410:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218298624 00000100:00100000:0.0:1788832003.981474:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788832003.981482:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf80ce0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+9:6547:x1875726218298624:12345-0@lo:502: 00000100:00100000:0.0:1788832003.982164:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf80ce0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+9:6547:x1875726218298624:12345-0@lo:502: Request processed in 678us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832003.982174:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788832003.982345:0:6547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001633581f pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:6547:1875726218298624:0@lo:502: 00000020:01000000:3.0:1788832003.982385:0:6547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832003.982394:0:6547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832003.982397:0:6547:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788832003.982402:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788832003.982653:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788832003.982745:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788832003.984564:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 0000000022897c45/0x998c12b283536af4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536afb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832003.984588:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 0000000022897c45/0x998c12b283536af4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536afb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832003.984600:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d2c40623800 from 1 10000000:01000000:0.0:1788832003.984603:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788832003.984673:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 000000005f193762/0x998c12b283536b48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832003.986129:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 000000005f193762/0x998c12b283536b48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832003.986143:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 000000005f193762/0x998c12b283536b48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832003.986179:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bb693a8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218298752:0@lo:101: 00000100:00100000:0.0:1788832003.986275:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832003.986333:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eb3f7070 going to sleep for 11 seconds 00000100:00100000:1.0:1788832003.986576:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218298752 00000100:00100000:1.0:1788832003.986587:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218298752 00000100:00100000:1.0:1788832003.986671:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788832003.986688:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000052e5f1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+9:6502:x1875726218298752:12345-0@lo:101: 00010000:00010000:1.0:1788832003.986707:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832003.986729:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007ad6a545/0x998c12b283536b4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536b48 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.986759:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ad6a545/0x998c12b283536b4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536b48 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.986771:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007ad6a545/0x998c12b283536b4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536b48 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.986780:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007ad6a545, rc 0) 00000100:00100000:1.0:1788832003.986834:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000052e5f1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+10:6502:x1875726218298752:12345-0@lo:101: Request processed in 147us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832003.986840:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788832003.987576:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bb693a8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218298752:0@lo:101: 00010000:00010000:0.0:1788832003.987604:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 000000005f193762/0x998c12b283536b48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536b4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832003.987615:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 000000005f193762/0x998c12b283536b48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536b4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832003.988472:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bb693a8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218298880:0@lo:256: 00000100:00100000:0.0:1788832003.989572:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832003.989646:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eb3f7070 going to sleep for 11 seconds 00000100:00100000:1.0:1788832003.989942:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218298880 00000100:00100000:1.0:1788832003.989953:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218298880 00000100:00100000:1.0:1788832003.990033:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788832003.990043:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088186851 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+10:6502:x1875726218298880:12345-0@lo:256: 20000000:01000000:1.0:1788832003.990098:0:6519:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788832003.990105:0:6519:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788832003.990202:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088186851 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+10:6502:x1875726218298880:12345-0@lo:256: Request processed in 161us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832003.990211:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788832003.990356:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bb693a8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218298880:0@lo:256: 10000000:01000000:0.0:1788832003.991379:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788832003.991445:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 000000005f193762/0x998c12b283536b48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536b4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832003.991459:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 000000005f193762/0x998c12b283536b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536b4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832003.991468:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2c40623800 from 1 10000000:01000000:0.0:1788832003.991471:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788832003.991519:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000f82b0de2/0x998c12b283536b56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832003.991526:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000f82b0de2/0x998c12b283536b56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832003.991536:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000f82b0de2/0x998c12b283536b56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832003.991559:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bb693a8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218299008:0@lo:101: 00000100:00100000:0.0:1788832003.991657:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832003.991750:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eb3f7070 going to sleep for 11 seconds 00000100:00100000:1.0:1788832003.991941:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218299008 00000100:00100000:1.0:1788832003.991950:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218299008 00000100:00100000:1.0:1788832003.992000:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788832003.992008:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001462878f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+10:6502:x1875726218299008:12345-0@lo:101: 00010000:00010000:1.0:1788832003.992022:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832003.992037:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000067ab0cac/0x998c12b283536b5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536b56 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.992062:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000067ab0cac/0x998c12b283536b5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536b56 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.992072:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000067ab0cac/0x998c12b283536b5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536b56 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832003.992090:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000067ab0cac, rc 0) 00000100:00100000:1.0:1788832003.992136:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001462878f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+11:6502:x1875726218299008:12345-0@lo:101: Request processed in 130us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832003.992142:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788832003.994149:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bb693a8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218299008:0@lo:101: 00010000:00010000:0.0:1788832003.994186:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000f82b0de2/0x998c12b283536b56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536b5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832003.994199:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000f82b0de2/0x998c12b283536b56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536b5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832003.994315:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bb693a8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218299136:0@lo:501: 00000100:00100000:0.0:1788832003.994379:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832003.994437:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eb3f7070 going to sleep for 11 seconds 00000100:00100000:1.0:1788832003.994520:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218299136 00000100:00100000:1.0:1788832003.994528:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218299136 00000100:00100000:1.0:1788832003.994585:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788832003.994594:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004eb2d53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+11:6502:x1875726218299136:12345-0@lo:501: 00000100:00100000:1.0:1788832003.995188:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004eb2d53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+11:6502:x1875726218299136:12345-0@lo:501: Request processed in 592us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832003.995210:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788832003.995366:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bb693a8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218299136:0@lo:501: 00000100:00100000:0.0:1788832003.995405:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bb693a8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218299264:0@lo:503: 00000100:00100000:0.0:1788832003.995450:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832003.995486:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eb3f7070 going to sleep for 11 seconds 00000100:00100000:1.0:1788832004.002384:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218299264 00000100:00100000:1.0:1788832004.002406:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218299264 00000100:00100000:1.0:1788832004.002483:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788832004.002495:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c8fe73e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+11:6502:x1875726218299264:12345-0@lo:503: 00000040:00080000:1.0:1788832004.002580:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788832004.002730:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c8fe73e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+11:6502:x1875726218299264:12345-0@lo:503: Request processed in 238us (7279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832004.002739:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788832004.004504:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bb693a8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218299264:0@lo:503: 00000040:00080000:3.0:1788832004.007987:0:6551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788832004.008274:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788832004.008302:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788832004.008323:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000f82b0de2/0x998c12b283536b56 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536b5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832004.008338:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000f82b0de2/0x998c12b283536b56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536b5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832004.008394:0:6502:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788832004.008397:0:6502:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d2c40623800 10000000:01000000:0.0:1788832004.008400:0:6502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d2c40623800 10000000:01000000:0.0:1788832004.008404:0:6502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788832004.008410:0:6502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d2c40623800 from 1 10000000:01000000:0.0:1788832004.008413:0:6502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788832004.008458:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 0000000055beffee/0x998c12b283536b64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832004.008465:0:6502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 0000000055beffee/0x998c12b283536b64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832004.008499:0:6502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 0000000055beffee/0x998c12b283536b64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832004.008528:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000532127e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218299392:0@lo:101: 00000100:00100000:0.0:1788832004.008647:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832004.008728:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f948ced going to sleep for 11 seconds 00000100:00100000:1.0:1788832004.008944:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218299392 00000100:00100000:1.0:1788832004.008954:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218299392 00000100:00100000:1.0:1788832004.009016:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788832004.009025:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ca23119 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+11:6502:x1875726218299392:12345-0@lo:101: 00010000:00010000:1.0:1788832004.009042:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832004.009057:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000078e187b1/0x998c12b283536b6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536b64 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832004.009097:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000078e187b1/0x998c12b283536b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536b64 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832004.009109:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000078e187b1/0x998c12b283536b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536b64 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832004.009118:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000078e187b1, rc 0) 00000100:00100000:1.0:1788832004.009174:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ca23119 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+12:6502:x1875726218299392:12345-0@lo:101: Request processed in 150us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832004.009182:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788832004.009408:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000532127e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218299392:0@lo:101: 00010000:00010000:0.0:1788832004.009425:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 0000000055beffee/0x998c12b283536b64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536b6b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832004.009435:0:6502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 0000000055beffee/0x998c12b283536b64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536b6b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832004.009507:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000532127e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218299520:0@lo:501: 00000100:00100000:0.0:1788832004.009536:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832004.009570:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f948ced going to sleep for 11 seconds 00000100:00100000:2.0:1788832004.009647:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218299520 00000100:00100000:2.0:1788832004.009651:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218299520 00000100:00100000:2.0:1788832004.009696:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788832004.009702:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1d0e1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+12:6502:x1875726218299520:12345-0@lo:501: 00000100:00100000:2.0:1788832004.010160:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1d0e1c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+12:6502:x1875726218299520:12345-0@lo:501: Request processed in 457us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832004.010168:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788832004.010976:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000532127e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218299520:0@lo:501: 00000100:00100000:3.0:1788832004.011034:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000095719a15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218299648:0@lo:503: 00000100:00100000:3.0:1788832004.011113:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832004.011146:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cf1fa391 going to sleep for 11 seconds 00000100:00100000:1.0:1788832004.011288:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218299648 00000100:00100000:1.0:1788832004.011301:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218299648 00000100:00100000:1.0:1788832004.011343:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788832004.011350:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004eef3799 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+12:6502:x1875726218299648:12345-0@lo:503: 00000100:00100000:1.0:1788832004.011468:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004eef3799 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+12:6502:x1875726218299648:12345-0@lo:503: Request processed in 118us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832004.011475:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788832004.011617:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000095719a15 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218299648:0@lo:503: 00000100:00100000:1.0:1788832004.019289:0:6552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c4d82d56 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:6552:1875726218299776:0@lo:502: 00000100:00100000:1.0:1788832004.019417:0:6552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832004.019493:0:6552:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f33c2531 going to sleep for 11 seconds 00000100:00100000:2.0:1788832004.019725:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218299776 00000100:00100000:2.0:1788832004.019735:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218299776 00000100:00100000:2.0:1788832004.019809:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788832004.019820:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff91645e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+12:6552:x1875726218299776:12345-0@lo:502: 00000100:00100000:2.0:1788832004.019975:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff91645e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+12:6552:x1875726218299776:12345-0@lo:502: Request processed in 157us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832004.019982:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788832004.020167:0:6552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c4d82d56 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:6552:1875726218299776:0@lo:502: 00000020:01000004:3.0:1788832004.020241:0:6552:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788832004.020273:0:6552:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006ae68da2) 00000020:00000080:3.0:1788832004.020298:0:6552:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788832004.020391:0:6552:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000021a28252 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788832004.020395:0:6552:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000021a28252 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788832004.020398:0:6552:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000021a28252 4 00010000:00080000:3.0:1788832004.020429:0:6552:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000077bd1397@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.126@tcp at head 00010000:00010000:3.0:1788832004.022064:0:6552:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788832004.022323:0:6552:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788832004.022369:0:6552:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788832004.022384:0:6552:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x998c12b283536b79 00000100:00080000:3.0:1788832004.022395:0:6552:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788832004.022401:0:6552:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000077bd1397 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788832004.022445:0:6552:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000095719a15 x1875726218299904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788832004.022471:0:6552:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788832004.023313:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000095719a15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875726218299904:0@lo:38: 00000100:00100000:0.0:1788832004.023408:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832004.026841:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218299904 00000100:00100000:1.0:1788832004.026865:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218299904 00000100:00100000:1.0:1788832004.026932:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832004.026941:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff5450ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1875726218299904:12345-0@lo:38: 00000100:00100000:1.0:1788832004.027072:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff5450ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1875726218299904:12345-0@lo:38: Request processed in 131us (3664us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788832004.027090:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832004.027153:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788832004.027162:0:3650:0:(import.c:65:import_set_state_nolock()) 0000000077bd1397 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788832004.027168:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788832004.027171:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000095719a15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875726218299904:0@lo:38: 00000100:00100000:1.0:1788832004.035866:0:6552:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dc889591 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:6552:1875726218300032:0@lo:502: 00000100:00100000:1.0:1788832004.036002:0:6552:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832004.036094:0:6552:0:(client.c:2715:ptlrpc_set_wait()) set 0000000067cfef5b going to sleep for 11 seconds 00000100:00100000:2.0:1788832004.036405:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218300032 00000100:00100000:2.0:1788832004.036415:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218300032 00000100:00100000:2.0:1788832004.036498:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788832004.036507:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002cb9b89e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+12:6552:x1875726218300032:12345-0@lo:502: 00000100:00100000:2.0:1788832004.036695:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002cb9b89e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+12:6552:x1875726218300032:12345-0@lo:502: Request processed in 189us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832004.036703:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788832004.041637:0:6552:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dc889591 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:6552:1875726218300032:0@lo:502: 00000040:00080000:1.0:1788832004.041713:0:6552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788832004.042016:0:6502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788832004.042057:0:6502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788832004.042091:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 0000000055beffee/0x998c12b283536b64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536b6b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832004.042105:0:6502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 0000000055beffee/0x998c12b283536b64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536b6b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788832004.042168:0:6502:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788832004.042175:0:6502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788832004.042176:0:6502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832004.042177:0:6502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832004.042178:0:6502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832004.042179:0:6502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832004.042181:0:6502:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788832004.042182:0:6502:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788832004.042183:0:6502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788832004.042184:0:6502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788832004.042185:0:6502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832004.042186:0:6502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788832004.042190:0:6502:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788832004.042193:0:6502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788832004.042194:0:6502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788832004.042195:0:6502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832004.042196:0:6502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832004.042197:0:6502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832004.042198:0:6502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832004.042199:0:6502:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788832004.042200:0:6502:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788832004.042201:0:6502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788832004.042202:0:6502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788832004.042202:0:6502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832004.042203:0:6502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788832004.042230:0:6502:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788832004.042247:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086b0d147 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218300160:0@lo:253: 00000100:00100000:0.0:1788832004.042326:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832004.042370:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eb3f7070 going to sleep for 11 seconds 00000100:00100000:1.0:1788832004.042611:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218300160 00000100:00100000:1.0:1788832004.042651:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218300160 00000100:00100000:1.0:1788832004.043750:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788832004.043771:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057110a0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+12:6502:x1875726218300160:12345-0@lo:253: 20000000:01000000:1.0:1788832004.044017:0:6519:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788832004.044038:0:6519:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788832004.058916:0:6519:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788832004.058946:0:6519:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788832004.059478:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057110a0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+12:6502:x1875726218300160:12345-0@lo:253: Request processed in 15707us (17145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832004.059494:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788832004.059707:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086b0d147 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:6502:1875726218300160:0@lo:253: 10000000:01000000:0.0:1788832004.059728:0:6502:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788832004.059732:0:6502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788832004.059734:0:6502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788832004.059736:0:6502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832004.059737:0:6502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832004.059739:0:6502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832004.059741:0:6502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832004.059742:0:6502:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788832004.059744:0:6502:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788832004.059775:0:6502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788832004.059777:0:6502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788832004.059779:0:6502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832004.059780:0:6502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788832004.059805:0:6502:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788832004.063116:0:6541:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788832004.063133:0:6541:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788832004.063174:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000aed1af78/0x998c12b283536b80 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.063201:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007ad6a545/0x998c12b283536b4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536b48 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.063209:0:6541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000aed1af78/0x998c12b283536b80 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.063268:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007ad6a545/0x998c12b283536b4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536b48 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.063289:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007ad6a545/0x998c12b283536b4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536b48 expref: 11 pid: 6519 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832004.063306:0:6541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000077f9cc59 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1875726218300288:0@lo:104: 00000100:00100000:2.0:1788832004.063425:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832004.063505:0:6541:0:(client.c:2715:ptlrpc_set_wait()) set 0000000052497975 going to sleep for 11 seconds 00000100:00100000:1.0:1788832004.063812:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218300288 00000100:00100000:1.0:1788832004.063826:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218300288 00000100:00100000:1.0:1788832004.063899:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832004.063909:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd1fc66d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+3:6541:x1875726218300288:12345-0@lo:104: 00010000:00010000:1.0:1788832004.063930:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 000000005f193762/0x998c12b283536b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536b4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832004.064017:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788832004.064023:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd1fc66d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+3:6541:x1875726218300288:12345-0@lo:104: Request processed in 116us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832004.064031:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788832004.064054:0:6541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000077f9cc59 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1875726218300288:0@lo:104: 00010000:00010000:3.0:1788832004.064094:0:6541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000aed1af78/0x998c12b283536b80 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.064358:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832004.064365:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 000000005f193762/0x998c12b283536b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536b4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.064373:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005f193762 already unused, calling callback (00000000954f4257) 10000000:00010000:2.0:1788832004.064388:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 000000005f193762/0x998c12b283536b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536b4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.064396:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 000000005f193762/0x998c12b283536b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536b4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832004.064403:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 000000005f193762/0x998c12b283536b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536b4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832004.064409:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832004.064452:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 000000005f193762/0x998c12b283536b48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536b4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.064459:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832004.064493:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 000000005f193762/0x998c12b283536b48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536b4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.064499:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 000000005f193762/0x998c12b283536b48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536b4f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.064515:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832004.064517:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832004.064518:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832004.064728:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2758da8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218300416:0@lo:103: 00000100:00100000:3.0:1788832004.064775:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832004.064843:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218300416 00000100:00100000:3.0:1788832004.064848:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218300416 00010000:00010000:3.0:1788832004.064871:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007ad6a545/0x998c12b283536b4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536b48 expref: 12 pid: 6519 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832004.064924:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788832004.064934:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f58ee1c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+12:3652:x1875726218300416:12345-0@lo:103: 00010000:00010000:2.0:1788832004.064947:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832004.064953:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007ad6a545/0x998c12b283536b4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536b48 expref: 12 pid: 6519 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.064965:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007ad6a545/0x998c12b283536b4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536b48 expref: 12 pid: 6519 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.064996:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007ad6a545/0x998c12b283536b4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536b48 expref: 12 pid: 6519 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.065011:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000aed1af78/0x998c12b283536b80 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.065019:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aed1af78/0x998c12b283536b80 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788832004.065034:0:6511:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001902355s 00010000:00010000:2.0:1788832004.065038:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000aed1af78/0x998c12b283536b80 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.065044:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000aed1af78/0x998c12b283536b80 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.065050:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000aed1af78/0x998c12b283536b80 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.065056:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000aed1af78/0x998c12b283536b80 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.065061:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000aed1af78 already unused, calling callback (000000002a293869) 00010000:00010000:2.0:1788832004.065065:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000aed1af78/0x998c12b283536b80 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.065072:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000aed1af78/0x998c12b283536b80 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.065096:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000aed1af78/0x998c12b283536b80 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.065115:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832004.065149:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f58ee1c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+11:3652:x1875726218300416:12345-0@lo:103: Request processed in 217us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832004.065155:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788832004.065183:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2758da8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218300416:0@lo:103: 00010000:00010000:2.0:1788832004.065187:0:6541:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000aed1af78/0x998c12b283536b80 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.065194:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000aed1af78/0x998c12b283536b80 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832004.065200:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000aed1af78/0x998c12b283536b80 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788832004.073003:0:6502:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1788832004.073254:0:6502:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788832004.075103:0:6502:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1788832004.075400:0:6502:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788832004.076972:0:6502:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1788832004.077191:0:6502:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788832004.079307:0:6502:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1788832004.079501:0:6502:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788832004.079720:0:6502:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1788832004.079890:0:6502:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788832004.080073:0:6502:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1788832004.080263:0:6502:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1788832004.102993:0:6502:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788832004.132534:0:6502:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788832004.132591:0:6557:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788832004.132598:0:6557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788832004.133534:0:6558:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788832004.134967:0:6502:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788832004.135107:0:6502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788832004.135589:0:6502:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788832004.135598:0:6502:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788832004.135741:0:6502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788832004.139277:0:6502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788832004.140661:0:6502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788832004.140748:0:6502:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788832004.141463:0:6502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788832004.142052:0:6502:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1788832004.145294:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788832004.145466:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788832004.145612:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788832004.145787:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788832004.145963:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788832004.151775:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788832004.159150:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788832004.159365:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788832004.159506:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788832004.159697:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788832004.159857:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788832004.160001:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788832004.160161:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788832004.160304:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788832004.160450:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788832004.160580:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000040:00080000:1.0:1788832004.164217:0:6558:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:1.0:1788832004.170287:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788832004.170692:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788832004.170815:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788832004.172678:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788832004.181487:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788832004.182408:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788832004.182592:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788832004.182874:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788832004.183339:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788832004.183498:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788832004.183696:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788832004.184485:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788832004.184696:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788832004.188132:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788832004.188389:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788832004.188523:0:6502:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788832004.189322:0:6502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1788832004.198819:0:6502:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788832004.198880:0:6502:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb56201c6b988 00100000:10000000:1.0:1788832004.198891:0:6502:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788832004.199895:0:6502:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788832004.199917:0:6502:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788832004.199944:0:6502:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788832004.199963:0:6502:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788832004.200941:0:6502:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788832004.201167:0:6502:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1788832004.203352:0:6558:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788832004.203458:0:6558:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788832004.203463:0:6558:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788832004.566940:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832005.591008:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832006.615400:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832007.644822:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832008.663758:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788832009.072561:0:6803:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788832009.431339:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000086b0d147 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218300544:0@lo:400: 00000100:00100000:3.0:1788832009.431435:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788832009.431524:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788832009.431530:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788832009.431533:0:36:0:(import.c:65:import_set_state_nolock()) 0000000077bd1397 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788832009.431545:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000077bd1397 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788832009.431572:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e5ab5d99 x1875726218300672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788832009.431731:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218300544 00000100:00100000:1.0:1788832009.431741:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218300544 00000100:00100000:1.0:1788832009.431828:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788832009.431838:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e221ac6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+11:3653:x1875726218300544:12345-0@lo:400: 00000100:00100000:1.0:1788832009.431964:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e221ac6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+11:3653:x1875726218300544:12345-0@lo:400: Request processed in 127us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832009.431972:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788832009.432061:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e5ab5d99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875726218300672:0@lo:38: 00000100:00100000:1.0:1788832009.432092:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832009.432204:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000086b0d147 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218300544:0@lo:400: 00000100:00100000:0.0:1788832009.432287:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218300672 00000100:00100000:0.0:1788832009.432291:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218300672 00000100:00100000:0.0:1788832009.432354:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788832009.432360:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc889591 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1875726218300672:12345-0@lo:38: 00010000:00080000:0.0:1788832009.432385:0:6527:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 149 last 0 00000020:00000080:0.0:1788832009.432428:0:6527:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x998c12b283536b87 00000004:00100000:0.0:1788832009.432484:0:6527:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788832009.432601:0:6527:0:(import.c:65:import_set_state_nolock()) 00000000795d06fe : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788832009.432787:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc889591 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875726218300672:12345-0@lo:38: Request processed in 426us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832009.432802:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788832009.432950:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e5ab5d99 x1875726218300672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788832019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788832009.432966:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788832009.432974:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788832009.432979:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788832009.432981:0:3650:0:(import.c:65:import_set_state_nolock()) 0000000077bd1397 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788832009.432987:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e5ab5d99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875726218300672:0@lo:38: 00010000:00010000:1.0:1788832009.692201:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788832010.008337:0:6855:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788832010.008548:0:6855:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788832010.711883:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832011.735190:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788832012.513010:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788832012.513031:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d2c40623800 from 3 10000000:01000000:3.0:1788832012.513039:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788832012.513103:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000e5c50d52/0x998c12b283536b8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832012.513119:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000e5c50d52/0x998c12b283536b8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832012.513131:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000e5c50d52/0x998c12b283536b8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832012.513159:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000125fe0f9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218300800:0@lo:101: 00000100:00100000:3.0:1788832012.513259:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832012.513322:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set 00000000478a9d3f going to sleep for 11 seconds 00000100:00100000:1.0:1788832012.513516:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218300800 00000100:00100000:1.0:1788832012.513526:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218300800 00000100:00100000:1.0:1788832012.513604:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788832012.513613:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9ce3837 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+11:6522:x1875726218300800:12345-0@lo:101: 00010000:00010000:1.0:1788832012.513654:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832012.513671:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000034daf608/0x998c12b283536b95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536b8e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832012.513700:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000034daf608/0x998c12b283536b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536b8e expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832012.513712:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000034daf608/0x998c12b283536b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536b8e expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832012.513722:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000034daf608, rc 0) 00000100:00100000:1.0:1788832012.513766:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9ce3837 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+12:6522:x1875726218300800:12345-0@lo:101: Request processed in 154us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832012.513774:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788832012.517344:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000125fe0f9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218300800:0@lo:101: 00010000:00010000:3.0:1788832012.517391:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000e5c50d52/0x998c12b283536b8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536b95 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832012.517407:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000e5c50d52/0x998c12b283536b8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536b95 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832012.517525:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000125fe0f9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218300928:0@lo:256: 00000100:00100000:3.0:1788832012.517617:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832012.517685:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set 00000000478a9d3f going to sleep for 11 seconds 00000100:00100000:1.0:1788832012.517761:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218300928 00000100:00100000:1.0:1788832012.517771:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218300928 00000100:00100000:1.0:1788832012.517839:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788832012.517849:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1e94ac4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+12:6522:x1875726218300928:12345-0@lo:256: 20000000:01000000:1.0:1788832012.517874:0:6518:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788832012.517894:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788832012.517897:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788832012.518013:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1e94ac4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+12:6522:x1875726218300928:12345-0@lo:256: Request processed in 165us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832012.518032:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788832012.518249:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000125fe0f9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218300928:0@lo:256: 10000000:01000000:3.0:1788832012.518298:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788832012.518308:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000e5c50d52/0x998c12b283536b8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536b95 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832012.518323:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000e5c50d52/0x998c12b283536b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536b95 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832012.759010:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788832012.845675:0:6956:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788832012.845903:0:6956:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788832013.787270:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832014.550884:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788832014.550930:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000076e45d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875726218301184:0@lo:400: 00000100:00100000:0.0:1788832014.551033:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832014.551092:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009aa4a7c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218301056:0@lo:400: 00000100:00100000:2.0:1788832014.551131:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832014.551162:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218301056 00000100:00100000:0.0:1788832014.551172:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218301056 00000100:00100000:2.0:1788832014.551176:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218301184 00000100:00100000:2.0:1788832014.551178:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218301184 00000100:00100000:2.0:1788832014.551219:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788832014.551219:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788832014.551226:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1437eb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875726218301184:12345-0@lo:400: 00000100:00100000:0.0:1788832014.551226:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f07030dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+12:3654:x1875726218301056:12345-0@lo:400: 00000100:00100000:2.0:1788832014.551280:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1437eb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875726218301184:12345-0@lo:400: Request processed in 54us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832014.551280:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f07030dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+12:3654:x1875726218301056:12345-0@lo:400: Request processed in 54us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832014.551287:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788832014.551287:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788832014.551341:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009aa4a7c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218301056:0@lo:400: 00010000:00080000:2.0:1788832014.551395:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000076e45d34 x1875726218301184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832014.551409:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000076e45d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875726218301184:0@lo:400: 00010000:00010000:0.0:1788832014.807052:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832015.833484:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832016.861177:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832017.879742:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832018.902805:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832019.672167:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f51307fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218301312:0@lo:400: 00000100:00100000:0.0:1788832019.672256:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832019.672427:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d15d2462 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218301440:0@lo:400: 00000100:00100000:3.0:1788832019.675146:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218301312 00000100:00100000:3.0:1788832019.675161:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218301312 00000100:00100000:1.0:1788832019.676124:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832019.676209:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218301440 00000100:00100000:1.0:1788832019.676215:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218301440 00000100:00100000:1.0:1788832019.676258:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788832019.676265:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a5144b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218301440:12345-0@lo:400: 00000100:00100000:3.0:1788832019.676523:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788832019.676531:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b838571 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+12:3652:x1875726218301312:12345-0@lo:400: 00000100:00100000:1.0:1788832019.677446:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a5144b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218301440:12345-0@lo:400: Request processed in 1177us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832019.677456:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788832019.677509:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d15d2462 x1875726218301440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832019.677523:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d15d2462 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218301440:0@lo:400: 00000100:00100000:3.0:1788832019.683113:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b838571 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+12:3652:x1875726218301312:12345-0@lo:400: Request processed in 6573us (10848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832019.683131:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788832019.684960:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f51307fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218301312:0@lo:400: 00010000:00010000:0.0:1788832019.927761:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832020.950732:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832021.975849:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788832022.315319:0:7454:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788832022.315324:0:7454:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788832022.315326:0:7454:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788832022.315439:0:7454:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c6c011bd 00000020:01000004:0.0:1788832022.315454:0:7454:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1788832022.315467:0:7454:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788832022.315491:0:7454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000d008fec1) 00000020:00000080:0.0:1788832022.315510:0:7454:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788832022.373857:0:7454:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1788832022.373928:0:7454:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1788832022.397693:0:7454:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788832022.397926:0:7454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1788832022.397937:0:7454:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788832022.397947:0:7454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x998c12b283536ba3 00000020:01000004:1.0:1788832022.397954:0:7454:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788832022.397986:0:7454:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.126@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788832022.397994:0:7454:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788832022.398001:0:7454:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1788832022.398029:0:7454:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1788832022.398033:0:7454:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788832022.426726:0:7454:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788832022.426769:0:7454:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.126@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1788832022.426774:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788832022.426776:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788832022.426777:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788832022.426778:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788832022.426780:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788832022.426781:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788832022.426782:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788832022.426784:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788832022.426785:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788832022.426788:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788832022.427016:0:7454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788832022.427022:0:7454:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1788832022.427025:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788832022.427026:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788832022.427028:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788832022.427029:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788832022.427030:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788832022.427031:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788832022.427033:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788832022.427034:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788832022.427034:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788832022.427039:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788832022.427040:0:7454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788832022.427071:0:7454:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788832022.427088:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007806296d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218301568:0@lo:253: 00000100:00100000:2.0:1788832022.427171:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832022.427224:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218301568 00000100:00100000:2.0:1788832022.427228:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 000000002020eb53 going to sleep for 11 seconds 00000100:00100000:1.0:1788832022.427233:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218301568 00000100:00100000:1.0:1788832022.427291:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788832022.427300:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035363b79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+12:7454:x1875726218301568:12345-0@lo:253: 20000000:01000000:1.0:1788832022.427339:0:6518:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788832022.427344:0:6518:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1788832022.427349:0:6518:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1788832022.427352:0:6518:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1788832022.427387:0:6518:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1788832022.427573:0:6518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788832022.427970:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788832022.427986:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788832022.428006:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788832022.428022:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788832022.428035:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788832022.428091:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1788832022.428100:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1788832022.428112:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1788832022.428118:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1788832022.428130:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1788832022.428134:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1788832022.428145:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788832022.428158:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788832022.428268:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1788832022.428278:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:1.0:1788832022.428292:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1788832022.428298:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788832022.428322:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1788832022.428329:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:1.0:1788832022.428341:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1788832022.428346:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788832022.428359:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788832022.428375:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788832022.428384:0:6518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1788832022.428466:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1788832022.428475:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1788832022.428487:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788832022.428502:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788832022.428518:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1788832022.428525:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1788832022.428538:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788832022.428558:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788832022.428564:0:6518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1788832022.432046:0:6518:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788832022.432059:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1788832022.432401:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788832022.432614:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788832022.432672:0:6518:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.126@tcp for mdt 20000000:01000000:3.0:1788832022.432675:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:3.0:1788832022.432693:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788832022.432700:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788832022.432715:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788832022.432721:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:3.0:1788832022.432738:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788832022.432746:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1788832022.432761:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1788832022.432778:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1788832022.432879:0:6518:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1788832022.432889:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1788832022.435083:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1788832022.435403:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788832022.435429:0:6518:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.126@tcp for mdt 20000000:01000000:3.0:1788832022.435432:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:3.0:1788832022.435470:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788832022.435478:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788832022.435491:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788832022.435496:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:3.0:1788832022.435509:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788832022.435516:0:6518:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1788832022.435529:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788832022.435543:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1788832022.435565:0:6518:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788832022.435568:0:6518:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788832022.435572:0:6518:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788832022.435814:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788832022.435817:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788832022.436327:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788832022.436359:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788832022.436373:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788832022.436502:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1788832022.436526:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1788832022.436541:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1788832022.436553:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788832022.436555:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788832022.437141:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788832022.437167:0:7463:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788832022.437181:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1788832022.438658:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788832022.438688:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788832022.438704:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1788832022.438714:0:6518:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788832022.438717:0:6518:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788832022.439382:0:7464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788832022.439409:0:7464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788832022.439427:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788832022.439821:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788832022.439858:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788832022.439886:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788832022.439903:0:6518:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788832022.439906:0:6518:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788832022.439911:0:6518:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788832022.439918:0:6518:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788832022.441482:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1788832022.441727:0:6518:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788832022.455673:0:6518:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788832022.455702:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000028613935/0x998c12b283536baa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.455737:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000091a2b1bd/0x998c12b283536adf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536ad8 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.455744:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007837698b/0x998c12b283536afb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536af4 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.455751:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000078e187b1/0x998c12b283536b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536b64 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.455757:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000028613935/0x998c12b283536baa lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.455797:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000078e187b1/0x998c12b283536b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536b64 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.455811:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000078e187b1/0x998c12b283536b6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536b64 expref: 12 pid: 6517 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832022.456248:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000125fe0f9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875726218301696:0@lo:104: 00000100:00100000:3.0:1788832022.456311:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788832022.456428:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007837698b/0x998c12b283536afb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536af4 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.456437:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007837698b/0x998c12b283536afb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536af4 expref: 12 pid: 6517 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832022.456444:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001afca9a3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875726218301824:0@lo:104: 00000100:00100000:3.0:1788832022.456465:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788832022.456858:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000091a2b1bd/0x998c12b283536adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536ad8 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.456877:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000091a2b1bd/0x998c12b283536adf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536ad8 expref: 12 pid: 6518 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832022.456885:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000750f164f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875726218301952:0@lo:104: 00000100:00100000:3.0:1788832022.456909:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832022.457455:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218301696 00000100:00100000:2.0:1788832022.457463:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218301696 00000100:00100000:2.0:1788832022.457565:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218301824 00000100:00100000:2.0:1788832022.457570:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218301824 00000100:00100000:2.0:1788832022.457588:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788832022.457596:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007676cad5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+4:6518:x1875726218301696:12345-0@lo:104: 00010000:00010000:2.0:1788832022.457608:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 0000000055beffee/0x998c12b283536b64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536b6b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.457702:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788832022.457707:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007676cad5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+4:6518:x1875726218301696:12345-0@lo:104: Request processed in 112us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832022.457715:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788832022.457733:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788832022.457738:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000150cbce0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+3:6518:x1875726218301824:12345-0@lo:104: 00010000:00010000:2.0:1788832022.457745:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 0000000022897c45/0x998c12b283536af4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536afb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.457788:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788832022.457792:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000150cbce0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+3:6518:x1875726218301824:12345-0@lo:104: Request processed in 55us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832022.457798:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788832022.457824:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788832022.457829:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 0000000055beffee/0x998c12b283536b64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536b6b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.457836:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000055beffee already unused, calling callback (00000000954f4257) 10000000:00010000:2.0:1788832022.457848:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 0000000055beffee/0x998c12b283536b64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536b6b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.457856:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 0000000055beffee/0x998c12b283536b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536b6b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832022.457862:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 0000000055beffee/0x998c12b283536b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536b6b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832022.457868:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832022.457900:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 0000000055beffee/0x998c12b283536b64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536b6b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.457907:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832022.457924:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 0000000055beffee/0x998c12b283536b64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536b6b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.457931:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 0000000055beffee/0x998c12b283536b64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536b6b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.457945:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832022.457962:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 0000000022897c45/0x998c12b283536af4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536afb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.457967:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000022897c45 already unused, calling callback (00000000954f4257) 10000000:00010000:2.0:1788832022.457970:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 0000000022897c45/0x998c12b283536af4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536afb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.457975:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 0000000022897c45/0x998c12b283536af4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536afb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832022.457991:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 0000000022897c45/0x998c12b283536af4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536afb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832022.457996:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832022.458010:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 0000000022897c45/0x998c12b283536af4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536afb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.458014:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832022.458025:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 0000000022897c45/0x998c12b283536af4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536afb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.458031:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 0000000022897c45/0x998c12b283536af4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536afb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.458039:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832022.458040:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832022.458042:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832022.458596:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832022.458605:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788832022.458641:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000092d21bc9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218302208:0@lo:103: 00000100:00100000:0.0:1788832022.458686:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832022.458917:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218302208 00000100:00100000:2.0:1788832022.458923:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218302208 00010000:00010000:2.0:1788832022.458945:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007837698b/0x998c12b283536afb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536af4 expref: 13 pid: 6517 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832022.458987:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788832022.458994:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057085c3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+13:3652:x1875726218302208:12345-0@lo:103: 00010000:00010000:2.0:1788832022.459005:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832022.459009:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007837698b/0x998c12b283536afb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536af4 expref: 13 pid: 6517 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.459018:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007837698b/0x998c12b283536afb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536af4 expref: 13 pid: 6517 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.459044:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832022.459074:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057085c3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+13:3652:x1875726218302208:12345-0@lo:103: Request processed in 81us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832022.459081:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788832022.459212:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000092d21bc9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218302208:0@lo:103: 00000100:00100000:3.0:1788832022.459307:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009c32fc7 going to sleep for 11 seconds 00000100:00100000:3.0:1788832022.459322:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000125fe0f9 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875726218301696:0@lo:104: 00010000:00010000:3.0:1788832022.459330:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007837698b/0x998c12b283536afb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536af4 expref: 12 pid: 6517 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832022.459341:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001afca9a3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875726218301824:0@lo:104: 00000100:00100000:2.0:1788832022.459385:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218301952 00000100:00100000:2.0:1788832022.459389:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218301952 00000100:00100000:2.0:1788832022.459410:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788832022.459415:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000759e3faa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+3:6518:x1875726218301952:12345-0@lo:104: 00010000:00010000:2.0:1788832022.459423:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 000000002ef8c5da/0x998c12b283536ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536adf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.459512:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788832022.459517:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000759e3faa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+3:6518:x1875726218301952:12345-0@lo:104: Request processed in 103us (2608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832022.459524:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788832022.459725:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832022.459730:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 000000002ef8c5da/0x998c12b283536ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536adf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.459737:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002ef8c5da already unused, calling callback (00000000954f4257) 10000000:00010000:0.0:1788832022.459740:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 000000002ef8c5da/0x998c12b283536ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536adf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.459746:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 000000002ef8c5da/0x998c12b283536ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536adf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832022.459753:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 000000002ef8c5da/0x998c12b283536ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536adf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832022.459759:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788832022.459797:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 000000002ef8c5da/0x998c12b283536ad8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536adf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.459803:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832022.460031:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 000000002ef8c5da/0x998c12b283536ad8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536adf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.460046:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 000000002ef8c5da/0x998c12b283536ad8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536adf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.460061:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832022.460062:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832022.460064:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832022.460076:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000042a6cc7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218302336:0@lo:103: 00000100:00100000:0.0:1788832022.460108:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832022.460216:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e81cad5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218302080:0@lo:103: 00000100:00100000:1.0:1788832022.460244:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832022.460653:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000750f164f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6518:1875726218301952:0@lo:104: 00010000:00010000:3.0:1788832022.460678:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000028613935/0x998c12b283536baa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832022.460805:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218302336 00000100:00100000:0.0:1788832022.460811:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218302336 00010000:00010000:0.0:1788832022.460835:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000091a2b1bd/0x998c12b283536adf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536ad8 expref: 12 pid: 6518 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832022.460865:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218302080 00000100:00100000:0.0:1788832022.460868:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218302080 00010000:00010000:0.0:1788832022.460878:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000078e187b1/0x998c12b283536b6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536b64 expref: 13 pid: 6517 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832022.460891:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788832022.460897:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db6ef2f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+13:3652:x1875726218302336:12345-0@lo:103: 00010000:00010000:0.0:1788832022.460907:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832022.460912:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000091a2b1bd/0x998c12b283536adf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536ad8 expref: 13 pid: 6518 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.460920:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000091a2b1bd/0x998c12b283536adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536ad8 expref: 13 pid: 6518 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.460933:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000091a2b1bd/0x998c12b283536adf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536ad8 expref: 13 pid: 6518 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832022.461037:0:6510:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788832022.461045:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788832022.461085:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832022.461163:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db6ef2f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+12:3652:x1875726218302336:12345-0@lo:103: Request processed in 265us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832022.461170:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788832022.461193:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788832022.461200:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d15d2462 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+11:3654:x1875726218302080:12345-0@lo:103: 00010000:00010000:0.0:1788832022.461216:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832022.461220:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000078e187b1/0x998c12b283536b6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536b64 expref: 11 pid: 6517 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.461228:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000078e187b1/0x998c12b283536b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536b64 expref: 11 pid: 6517 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.461236:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000078e187b1/0x998c12b283536b6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536b64 expref: 11 pid: 6517 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.461247:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000028613935/0x998c12b283536baa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.461254:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000028613935/0x998c12b283536baa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.461264:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000028613935/0x998c12b283536baa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.461270:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000028613935/0x998c12b283536baa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.461275:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000028613935/0x998c12b283536baa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.461285:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000028613935/0x998c12b283536baa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.461291:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000028613935 already unused, calling callback (000000002a293869) 00010000:00010000:0.0:1788832022.461294:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000028613935/0x998c12b283536baa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.461301:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000028613935/0x998c12b283536baa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.461321:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000028613935/0x998c12b283536baa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.461329:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832022.461368:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d15d2462 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+10:3654:x1875726218302080:12345-0@lo:103: Request processed in 170us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832022.461375:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788832022.461378:0:6518:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000028613935/0x998c12b283536baa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832022.461395:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000028613935/0x998c12b283536baa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832022.461400:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000028613935/0x998c12b283536baa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832022.461405:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e81cad5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218302080:0@lo:103: 20000000:01000000:1.0:1788832022.461416:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788832022.464296:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000042a6cc7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218302336:0@lo:103: 00000100:00100000:1.0:1788832022.464773:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035363b79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+9:7454:x1875726218301568:12345-0@lo:253: Request processed in 37473us (37601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832022.464908:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788832022.465049:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007806296d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218301568:0@lo:253: 10000000:01000000:2.0:1788832022.465064:0:7454:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788832022.465067:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788832022.465068:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788832022.465069:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788832022.465070:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1788832022.465072:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788832022.465073:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788832022.465074:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788832022.465075:0:7454:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788832022.465077:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788832022.465078:0:7454:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788832022.465094:0:7454:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c6c011bd from lustre-MDT0001 10000000:01000000:2.0:1788832022.465124:0:7454:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788832022.465127:0:7454:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788832022.465145:0:7454:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d2c18e319b8 local copy 10000000:01000000:2.0:1788832022.465148:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788832022.465258:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000bb583b27/0x998c12b283536bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.465270:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.126@tcp lock: 00000000bb583b27/0x998c12b283536bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.465279:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000bb583b27/0x998c12b283536bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832022.465296:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007806296d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218302464:0@lo:101: 00000100:00100000:2.0:1788832022.465331:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832022.465447:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 0000000031924787 going to sleep for 11 seconds 00000100:00100000:3.0:1788832022.465756:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218302464 00000100:00100000:3.0:1788832022.465764:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218302464 00000100:00100000:3.0:1788832022.465821:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788832022.465830:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ca9061f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+9:7454:x1875726218302464:12345-0@lo:101: 00010000:00010000:3.0:1788832022.465843:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832022.465857:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c963a609/0x998c12b283536bb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536bb1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.465880:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c963a609/0x998c12b283536bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536bb1 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.465899:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c963a609/0x998c12b283536bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536bb1 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.465908:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c963a609, rc 0) 00000100:00100000:3.0:1788832022.465943:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ca9061f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+10:7454:x1875726218302464:12345-0@lo:101: Request processed in 116us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832022.466217:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007806296d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218302464:0@lo:101: 00010000:00010000:2.0:1788832022.466232:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000bb583b27/0x998c12b283536bb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x998c12b283536bb8 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.466246:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000bb583b27/0x998c12b283536bb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x998c12b283536bb8 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832022.466334:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007806296d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218302592:0@lo:501: 00000100:00100000:2.0:1788832022.466361:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832022.466384:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 0000000031924787 going to sleep for 11 seconds 00000100:00100000:2.0:1788832022.466401:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218302592 00000100:00100000:2.0:1788832022.466405:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218302592 00000100:00100000:2.0:1788832022.466425:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788832022.466430:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e17fe0ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+11:7454:x1875726218302592:12345-0@lo:501: 00000100:00100000:2.0:1788832022.466697:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e17fe0ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+11:7454:x1875726218302592:12345-0@lo:501: Request processed in 267us (335us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788832022.466711:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788832022.466740:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007806296d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218302592:0@lo:501: 10000000:01000000:2.0:1788832022.466752:0:7454:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788832022.466770:0:7454:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788832022.466774:0:7454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000bb583b27/0x998c12b283536bb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x998c12b283536bb8 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.466781:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000bb583b27/0x998c12b283536bb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x998c12b283536bb8 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.466789:0:7454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: 00000000bb583b27/0x998c12b283536bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x998c12b283536bb8 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.466805:0:7454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788832022.466889:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d2c39185800 10000000:01000000:2.0:1788832022.466895:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788832022.466899:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9d2c18e319b8 10000000:01000000:2.0:1788832022.466902:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788832022.466904:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9d2c18e319b8 from 1 10000000:01000000:2.0:1788832022.466907:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788832022.466923:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000a425dbc4/0x998c12b283536bbf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.466930:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000a425dbc4/0x998c12b283536bbf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.466936:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000a425dbc4/0x998c12b283536bbf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832022.467109:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007806296d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218302720:0@lo:101: 00000100:00100000:2.0:1788832022.467139:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832022.467204:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788832022.467246:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 000000006577c139 going to sleep for 11 seconds 00010000:00010000:0.0:1788832022.467327:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832022.467332:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 00000000bb583b27/0x998c12b283536bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x998c12b283536bb8 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.467340:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bb583b27 already unused, calling callback (00000000954f4257) 10000000:00010000:0.0:1788832022.467342:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 00000000bb583b27/0x998c12b283536bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x998c12b283536bb8 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.467349:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 00000000bb583b27/0x998c12b283536bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x998c12b283536bb8 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832022.467365:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 00000000bb583b27/0x998c12b283536bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x998c12b283536bb8 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832022.467371:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788832022.467390:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 00000000bb583b27/0x998c12b283536bb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x998c12b283536bb8 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.467396:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832022.467412:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 00000000bb583b27/0x998c12b283536bb1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x998c12b283536bb8 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.467418:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 00000000bb583b27/0x998c12b283536bb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x998c12b283536bb8 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.467434:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832022.467436:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832022.467437:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832022.467447:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002076d71c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218302848:0@lo:103: 00000100:00100000:0.0:1788832022.467476:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832022.467524:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218302848 00000100:00100000:0.0:1788832022.467528:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218302848 00000100:00100000:0.0:1788832022.467577:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788832022.467584:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000681c7b24 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e55f0905-9d39-4464-9830-326b420fb582+10:3653:x1875726218302848:12345-0@lo:103: 00010000:00010000:0.0:1788832022.467596:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832022.467609:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c963a609/0x998c12b283536bb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x998c12b283536bb1 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.467637:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832022.467670:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000681c7b24 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e55f0905-9d39-4464-9830-326b420fb582+9:3653:x1875726218302848:12345-0@lo:103: Request processed in 87us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832022.467681:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788832022.467708:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002076d71c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218302848:0@lo:103: 00000100:00100000:3.0:1788832022.468147:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218302720 00000100:00100000:3.0:1788832022.468153:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218302720 00000100:00100000:1.0:1788832022.468222:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788832022.468232:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095515790 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+9:7454:x1875726218302720:12345-0@lo:101: 00010000:00010000:1.0:1788832022.468244:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832022.468257:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c767e0f7/0x998c12b283536bc6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536bbf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832022.468276:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c767e0f7/0x998c12b283536bc6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536bbf expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832022.468286:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c767e0f7/0x998c12b283536bc6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536bbf expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832022.468292:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c767e0f7, rc 0) 00000100:00100000:1.0:1788832022.468333:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095515790 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+10:7454:x1875726218302720:12345-0@lo:101: Request processed in 104us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832022.468339:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788832022.468453:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007806296d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218302720:0@lo:101: 00010000:00010000:2.0:1788832022.468466:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000a425dbc4/0x998c12b283536bbf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536bc6 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.468473:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000a425dbc4/0x998c12b283536bbf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536bc6 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832022.468488:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788832022.468805:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000a425dbc4/0x998c12b283536bbf lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536bc6 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.468821:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000a425dbc4/0x998c12b283536bbf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536bc6 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832022.468832:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d2c39185800 10000000:01000000:2.0:1788832022.468838:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788832022.468842:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9d2c39185800 from 1 10000000:01000000:2.0:1788832022.468845:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788832022.468868:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 0000000040a0e5d7/0x998c12b283536bcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.468876:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 0000000040a0e5d7/0x998c12b283536bcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.468883:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 0000000040a0e5d7/0x998c12b283536bcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832022.468912:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007806296d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218302976:0@lo:101: 00000100:00100000:2.0:1788832022.468946:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832022.469181:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000851a840c going to sleep for 11 seconds 00000100:00100000:2.0:1788832022.469211:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218302976 00000100:00100000:2.0:1788832022.469216:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218302976 00000100:00100000:2.0:1788832022.469244:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788832022.469250:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088d774ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+10:7454:x1875726218302976:12345-0@lo:101: 00010000:00010000:2.0:1788832022.469259:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832022.469268:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001a24f45c/0x998c12b283536bd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536bcd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.469282:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001a24f45c/0x998c12b283536bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536bcd expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.469289:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001a24f45c/0x998c12b283536bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536bcd expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.469296:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001a24f45c, rc 0) 00000100:00100000:2.0:1788832022.469328:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088d774ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+11:7454:x1875726218302976:12345-0@lo:101: Request processed in 78us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832022.469334:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788832022.469362:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007806296d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218302976:0@lo:101: 00010000:00010000:2.0:1788832022.469372:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 0000000040a0e5d7/0x998c12b283536bcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536bd4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.469379:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 0000000040a0e5d7/0x998c12b283536bcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536bd4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832022.469401:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788832022.469965:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 0000000040a0e5d7/0x998c12b283536bcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536bd4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.469975:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 0000000040a0e5d7/0x998c12b283536bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536bd4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832022.469981:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788832022.469985:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788832022.469989:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d2c39185800 10000000:01000000:2.0:1788832022.469991:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788832022.469994:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788832022.469996:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788832022.470016:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000aed1af78/0x998c12b283536bdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.470022:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000aed1af78/0x998c12b283536bdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.470029:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000aed1af78/0x998c12b283536bdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832022.470044:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007806296d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218303104:0@lo:101: 00000100:00100000:2.0:1788832022.470076:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832022.470094:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000851a840c going to sleep for 11 seconds 00000100:00100000:3.0:1788832022.470204:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218303104 00000100:00100000:3.0:1788832022.470209:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218303104 00000100:00100000:3.0:1788832022.470274:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788832022.470281:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d39ecd2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+11:7454:x1875726218303104:12345-0@lo:101: 00010000:00010000:3.0:1788832022.470290:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832022.470300:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007c9743b6/0x998c12b283536be2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536bdb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.470321:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007c9743b6/0x998c12b283536be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536bdb expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.470329:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007c9743b6/0x998c12b283536be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536bdb expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.470336:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007c9743b6, rc 0) 00000100:00100000:3.0:1788832022.470378:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d39ecd2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+12:7454:x1875726218303104:12345-0@lo:101: Request processed in 97us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832022.470384:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788832022.470443:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007806296d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218303104:0@lo:101: 00010000:00010000:2.0:1788832022.470453:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000aed1af78/0x998c12b283536bdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536be2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.470474:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000aed1af78/0x998c12b283536bdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536be2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832022.470579:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007806296d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218303232:0@lo:501: 00000100:00100000:2.0:1788832022.470603:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832022.471059:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218303232 00000100:00100000:1.0:1788832022.471065:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218303232 00000100:00100000:2.0:1788832022.471078:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000851a840c going to sleep for 11 seconds 00000100:00100000:0.0:1788832022.471114:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788832022.471122:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bb9c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+12:7454:x1875726218303232:12345-0@lo:501: 00000100:00100000:0.0:1788832022.471292:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bb9c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+12:7454:x1875726218303232:12345-0@lo:501: Request processed in 171us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832022.471299:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788832022.471353:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007806296d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218303232:0@lo:501: 00000100:00100000:2.0:1788832022.471383:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007806296d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218303360:0@lo:503: 00000100:00100000:2.0:1788832022.471421:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832022.471888:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000851a840c going to sleep for 11 seconds 00000100:00100000:1.0:1788832022.471981:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218303360 00000100:00100000:1.0:1788832022.471986:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218303360 00000100:00100000:1.0:1788832022.472021:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788832022.472028:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bce15852 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+12:7454:x1875726218303360:12345-0@lo:503: 00000100:00100000:1.0:1788832022.472120:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bce15852 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+12:7454:x1875726218303360:12345-0@lo:503: Request processed in 93us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832022.472127:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788832022.472201:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007806296d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218303360:0@lo:503: 00000040:00080000:2.0:1788832022.472487:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788832022.472693:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007806296d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218303488:0@lo:502: 00000100:00100000:2.0:1788832022.472728:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832022.472792:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000851a840c going to sleep for 11 seconds 00000100:00100000:0.0:1788832022.472904:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218303488 00000100:00100000:0.0:1788832022.472908:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218303488 00000100:00100000:0.0:1788832022.472935:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788832022.472940:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a45b748 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+12:7454:x1875726218303488:12345-0@lo:502: 00000100:00100000:0.0:1788832022.473095:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a45b748 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+12:7454:x1875726218303488:12345-0@lo:502: Request processed in 154us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832022.473103:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788832022.473117:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007806296d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218303488:0@lo:502: 00000040:00080000:2.0:1788832022.473329:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788832022.473355:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1788832022.473368:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1788832022.473379:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1788832022.473391:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1788832022.473404:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1788832022.473415:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1788832022.473426:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1788832022.473440:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1788832022.473454:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1788832022.473477:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1788832022.473490:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1788832022.473504:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1788832022.473516:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1788832022.473529:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1788832022.473541:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1788832022.473663:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1788832022.473681:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1788832022.473693:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1788832022.473706:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1788832022.473718:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1788832022.473731:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1788832022.473742:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1788832022.473771:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007806296d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218303616:0@lo:502: 00000100:00100000:2.0:1788832022.473942:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832022.473983:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000851a840c going to sleep for 11 seconds 00000100:00100000:1.0:1788832022.474045:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218303616 00000100:00100000:1.0:1788832022.474051:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218303616 00000100:00100000:1.0:1788832022.474094:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788832022.474101:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4e1dc6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+12:7454:x1875726218303616:12345-0@lo:502: 00000100:00100000:1.0:1788832022.474216:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4e1dc6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+12:7454:x1875726218303616:12345-0@lo:502: Request processed in 116us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832022.474221:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788832022.474439:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007806296d pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218303616:0@lo:502: 00000040:00080000:2.0:1788832022.474488:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1788832022.474496:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1788832022.475354:0:7467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832022.475368:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832022.475371:0:7467:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788832022.475376:0:7467:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788832022.475379:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788832022.475394:0:7467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000008b59a383) 00000020:00000080:0.0:1788832022.475417:0:7467:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1788832022.475423:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788832022.478121:0:7467:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788832022.478137:0:7467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x998c12b283536bf0 00000020:00000080:0.0:1788832022.478349:0:7467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788832022.478360:0:7467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832022.478372:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832022.478374:0:7467:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788832022.478378:0:7467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832022.478384:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832022.478385:0:7467:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788832022.478389:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788832022.478400:0:7467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000069ea6ed3) 00000020:00000080:0.0:1788832022.478416:0:7467:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1788832022.478421:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788832022.478424:0:7467:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788832022.478427:0:7467:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788832022.478434:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788832022.478481:0:7467:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c6c011bd from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788832022.478493:0:7467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000004c395b61) 00000020:00000080:0.0:1788832022.478501:0:7467:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1788832022.478742:0:7467:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788832022.478748:0:7467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x998c12b283536c05 00000020:00000080:0.0:1788832022.479101:0:7467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788832022.479110:0:7467:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788832022.479114:0:7467:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x998c12b283536c0c 00080000:01000000:0.0:1788832022.479120:0:7467:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788832022.479124:0:7467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x998c12b283536c13 00080000:10000000:0.0:1788832022.479930:0:7467:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1788832022.480268:0:7467:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1788832022.572084:0:7467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1788832022.572328:0:7467:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1788832022.579775:0:7467:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788832022.580146:0:7467:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788832022.596597:0:7467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788832022.596613:0:7467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832022.596650:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832022.596653:0:7467:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788832022.596659:0:7467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832022.596685:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832022.596687:0:7467:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788832022.596692:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788832022.596697:0:7467:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:00000080:3.0:1788832022.596724:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788832022.596737:0:7467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000002abff833) 00000020:00000080:3.0:1788832022.596760:0:7467:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788832022.596765:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788832022.596843:0:7467:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788832022.596850:0:7467:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788832022.596857:0:7467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x998c12b283536c21 00010000:00080000:1.0:1788832022.597059:0:7467:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004ba245fe@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:1.0:1788832022.600737:0:7467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1788832022.606191:0:7467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788832022.606207:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788832022.606247:0:7467:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788832022.606267:0:7467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x998c12b283536c28 00000100:00080000:1.0:1788832022.606279:0:7467:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788832022.606284:0:7467:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000004ba245fe using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788832022.606322:0:7467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000009fc557a x1875726218303744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788832022.606355:0:7467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1788832022.606437:0:7467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832022.606442:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832022.606444:0:7467:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788832022.606456:0:7467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788832022.606459:0:7467:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788832022.606461:0:7467:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788832022.606463:0:7467:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788832022.606465:0:7467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788832022.606467:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832022.606469:0:7467:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788832022.606472:0:7467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832022.606477:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832022.606479:0:7467:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788832022.606484:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788832022.606520:0:7467:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788832022.606533:0:7467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832022.606536:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832022.606537:0:7467:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788832022.606540:0:7467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832022.606542:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832022.606544:0:7467:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788832022.606546:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788832022.606548:0:7467:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788832022.606588:0:7467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832022.606601:0:7467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832022.606603:0:7467:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788832022.606606:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:0.0:1788832022.607126:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788832022.607141:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002076d71c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218303872:0@lo:400: 00000100:00100000:0.0:1788832022.607213:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832022.607287:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218303872 00000100:00100000:0.0:1788832022.607295:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218303872 00000100:00100000:0.0:1788832022.607345:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788832022.607355:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d04e815 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218303872:12345-0@lo:400: 00000100:00100000:0.0:1788832022.607408:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d04e815 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218303872:12345-0@lo:400: Request processed in 55us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832022.607422:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788832022.607465:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002076d71c x1875726218303872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832022.607479:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002076d71c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218303872:0@lo:400: 00000100:00100000:2.0:1788832022.607569:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009fc557a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218303744:0@lo:38: 00000100:00100000:2.0:1788832022.607765:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832022.607860:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218303744 00000100:00100000:0.0:1788832022.607864:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218303744 00000100:00100000:0.0:1788832022.607888:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788832022.607892:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007806296d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1875726218303744:12345-0@lo:38: 00010000:00080000:0.0:1788832022.607912:0:6530:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:0.0:1788832022.607941:0:6530:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x998c12b283536c2f 00000004:00100000:0.0:1788832022.607964:0:6530:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788832022.607969:0:6530:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:2.0:1788832022.608062:0:7454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1788832022.608099:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788832022.608117:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000aed1af78/0x998c12b283536bdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536be2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.608128:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000aed1af78/0x998c12b283536bdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536be2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832022.608136:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d2c39185800 from 1 10000000:01000000:2.0:1788832022.608144:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788832022.608168:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 0000000036ff4be4/0x998c12b283536c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.608175:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 0000000036ff4be4/0x998c12b283536c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.608184:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 0000000036ff4be4/0x998c12b283536c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832022.608197:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000048158697 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218304000:0@lo:101: 00000100:00100000:2.0:1788832022.608224:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832022.608236:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 000000006577c139 going to sleep for 11 seconds 00000100:00100000:0.0:1788832022.608291:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218304000 00000100:00100000:0.0:1788832022.608295:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218304000 00000100:00100000:0.0:1788832022.608326:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788832022.608331:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075d2940b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+12:7454:x1875726218304000:12345-0@lo:101: 00010000:00010000:0.0:1788832022.608340:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832022.608351:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000091a2b1bd/0x998c12b283536c3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536c36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.608369:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000091a2b1bd/0x998c12b283536c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536c36 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.608378:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000091a2b1bd/0x998c12b283536c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536c36 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.608386:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000091a2b1bd, rc 0) 00000100:00100000:0.0:1788832022.608423:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075d2940b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+13:7454:x1875726218304000:12345-0@lo:101: Request processed in 92us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832022.608428:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788832022.608465:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000048158697 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218304000:0@lo:101: 00010000:00010000:0.0:1788832022.608477:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 0000000036ff4be4/0x998c12b283536c36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536c3d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.608484:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 0000000036ff4be4/0x998c12b283536c36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536c3d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832022.609260:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002076d71c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218304128:0@lo:256: 00000100:00100000:0.0:1788832022.610334:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832022.610387:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000db9c2b1f going to sleep for 11 seconds 00000100:00100000:2.0:1788832022.610501:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218304128 00000100:00100000:2.0:1788832022.610510:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218304128 00000100:00100000:2.0:1788832022.610564:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788832022.610572:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c5cee82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+13:7454:x1875726218304128:12345-0@lo:256: 20000000:01000000:2.0:1788832022.610748:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788832022.610768:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788832022.610771:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788832022.610931:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c5cee82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+13:7454:x1875726218304128:12345-0@lo:256: Request processed in 358us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832022.610939:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788832022.611134:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002076d71c pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218304128:0@lo:256: 10000000:01000000:1.0:1788832022.611751:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788832022.611778:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 0000000036ff4be4/0x998c12b283536c36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536c3d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832022.611789:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 0000000036ff4be4/0x998c12b283536c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536c3d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832022.611974:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2c39185800 from 1 10000000:01000000:1.0:1788832022.611986:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788832022.612015:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000d2639d0c/0x998c12b283536c44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832022.612021:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000d2639d0c/0x998c12b283536c44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832022.612030:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000d2639d0c/0x998c12b283536c44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832022.612048:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f8e69e5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218304256:0@lo:101: 00000100:00100000:1.0:1788832022.612094:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832022.612132:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074d07cbc going to sleep for 11 seconds 00000100:00100000:3.0:1788832022.612140:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218304256 00000100:00100000:3.0:1788832022.612147:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218304256 00000100:00100000:3.0:1788832022.612173:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788832022.612179:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008907e942 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+13:7454:x1875726218304256:12345-0@lo:101: 00010000:00010000:3.0:1788832022.612189:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832022.612199:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ff97bcfb/0x998c12b283536c4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536c44 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.612216:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ff97bcfb/0x998c12b283536c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536c44 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.612224:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ff97bcfb/0x998c12b283536c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536c44 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.612237:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ff97bcfb, rc 0) 00000100:00100000:3.0:1788832022.612277:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008907e942 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+14:7454:x1875726218304256:12345-0@lo:101: Request processed in 99us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832022.612282:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788832022.612325:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f8e69e5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218304256:0@lo:101: 00010000:00010000:1.0:1788832022.612338:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000d2639d0c/0x998c12b283536c44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536c4b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832022.612346:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000d2639d0c/0x998c12b283536c44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536c4b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832022.612437:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f8e69e5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218304384:0@lo:501: 00000100:00100000:1.0:1788832022.612461:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832022.612490:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074d07cbc going to sleep for 11 seconds 00000100:00100000:3.0:1788832022.613170:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218304384 00000100:00100000:3.0:1788832022.613178:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218304384 00000100:00100000:3.0:1788832022.613208:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788832022.613214:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b98573d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+14:7454:x1875726218304384:12345-0@lo:501: 00000100:00100000:3.0:1788832022.613373:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b98573d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+14:7454:x1875726218304384:12345-0@lo:501: Request processed in 159us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832022.613379:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788832022.617127:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f8e69e5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218304384:0@lo:501: 00000100:00100000:1.0:1788832022.617190:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f8e69e5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218304512:0@lo:503: 00000100:00100000:1.0:1788832022.617263:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832022.617297:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074d07cbc going to sleep for 11 seconds 00000100:00100000:2.0:1788832022.618172:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218304512 00000100:00100000:2.0:1788832022.618182:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218304512 00000100:00100000:2.0:1788832022.618237:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788832022.618245:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077de83a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+14:7454:x1875726218304512:12345-0@lo:503: 00000040:00080000:2.0:1788832022.618296:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788832022.618368:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077de83a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+14:7454:x1875726218304512:12345-0@lo:503: Request processed in 123us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832022.618382:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788832022.619056:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f8e69e5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218304512:0@lo:503: 00000040:00080000:1.0:1788832022.619341:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788832022.619414:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1788832022.619495:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1788832022.620963:0:6530:0:(import.c:65:import_set_state_nolock()) 00000000e5c0edab : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832022.621072:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007806296d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875726218303744:12345-0@lo:38: Request processed in 13177us (13306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832022.621087:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788832022.621436:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788832022.621445:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788832022.621453:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788832022.621459:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788832022.621461:0:3650:0:(import.c:65:import_set_state_nolock()) 000000004ba245fe lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788832022.621476:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009fc557a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218303744:0@lo:38: 00000040:00080000:1.0:1788832022.621541:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1788832022.621704:0:7454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788832022.621730:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788832022.621745:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000d2639d0c/0x998c12b283536c44 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536c4b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.621755:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000d2639d0c/0x998c12b283536c44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536c4b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832022.621818:0:7454:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788832022.621820:0:7454:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d2c39185800 10000000:01000000:0.0:1788832022.621823:0:7454:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d2c39185800 10000000:01000000:0.0:1788832022.621828:0:7454:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788832022.621833:0:7454:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d2c39185800 from 1 10000000:01000000:0.0:1788832022.621835:0:7454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788832022.621866:0:7454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 00000000c6f68271/0x998c12b283536c52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.621886:0:7454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 00000000c6f68271/0x998c12b283536c52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.621895:0:7454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 00000000c6f68271/0x998c12b283536c52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832022.621913:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004db71db2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218304640:0@lo:101: 00000100:00100000:1.0:1788832022.621970:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000059bc9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218304768:0@lo:41: 00000100:00100000:0.0:1788832022.621971:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832022.622002:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832022.622005:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 000000002f406ca5 going to sleep for 11 seconds 00000100:00100000:0.0:1788832022.622023:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218304640 00000100:00100000:0.0:1788832022.622029:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218304640 00000100:00100000:0.0:1788832022.622066:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788832022.622073:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003193aff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+14:7454:x1875726218304640:12345-0@lo:101: 00010000:00010000:0.0:1788832022.622084:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832022.622095:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004c61cb1c/0x998c12b283536c59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536c52 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.622117:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004c61cb1c/0x998c12b283536c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536c52 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.622126:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004c61cb1c/0x998c12b283536c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536c52 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.622134:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004c61cb1c, rc 0) 00000100:00100000:0.0:1788832022.622174:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003193aff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+15:7454:x1875726218304640:12345-0@lo:101: Request processed in 102us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832022.622181:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788832022.622483:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004db71db2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218304640:0@lo:101: 00010000:00010000:2.0:1788832022.622496:0:7454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 00000000c6f68271/0x998c12b283536c52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536c59 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832022.622505:0:7454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 00000000c6f68271/0x998c12b283536c52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536c59 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832022.622606:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059861ff1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218304896:0@lo:501: 00000100:00100000:2.0:1788832022.622664:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832022.622679:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000605fc85d going to sleep for 11 seconds 00000100:00100000:3.0:1788832022.622756:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218304896 00000100:00100000:3.0:1788832022.622761:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218304896 00000100:00100000:3.0:1788832022.622786:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788832022.622803:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009664a334 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+15:7454:x1875726218304896:12345-0@lo:501: 00000100:00100000:3.0:1788832022.622908:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009664a334 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+15:7454:x1875726218304896:12345-0@lo:501: Request processed in 116us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832022.622915:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788832022.623081:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059861ff1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218304896:0@lo:501: 00000100:00100000:2.0:1788832022.623110:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059861ff1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218305024:0@lo:503: 00000100:00100000:2.0:1788832022.623148:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832022.623178:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000605fc85d going to sleep for 11 seconds 00000100:00100000:3.0:1788832022.623223:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218305024 00000100:00100000:3.0:1788832022.623234:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218305024 00000100:00100000:3.0:1788832022.623264:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788832022.623270:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041c23bf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:7454:x1875726218305024:12345-0@lo:503: 00000100:00100000:3.0:1788832022.623343:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041c23bf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:7454:x1875726218305024:12345-0@lo:503: Request processed in 73us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832022.623350:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788832022.624114:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218304768 00000100:00100000:3.0:1788832022.624121:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218304768 00000100:00100000:3.0:1788832022.624152:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788832022.624159:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8e69e5b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1875726218304768:12345-0@lo:41: 00000004:00000024:3.0:1788832022.624186:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788832022.624351:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059861ff1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218305024:0@lo:503: 00000040:00080000:2.0:1788832022.624684:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788832022.624766:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059861ff1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218305152:0@lo:502: 00000100:00100000:2.0:1788832022.624820:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832022.624859:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000605fc85d going to sleep for 11 seconds 00000100:00100000:0.0:1788832022.625366:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218305152 00000100:00100000:0.0:1788832022.625379:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218305152 00000100:00100000:0.0:1788832022.625439:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788832022.625446:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098ae49f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:7454:x1875726218305152:12345-0@lo:502: 00000100:00100000:0.0:1788832022.625556:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098ae49f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:7454:x1875726218305152:12345-0@lo:502: Request processed in 112us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832022.625564:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788832022.625766:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059861ff1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218305152:0@lo:502: 00000040:00080000:2.0:1788832022.626017:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788832022.626045:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788832022.626062:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788832022.626074:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788832022.626085:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788832022.626095:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788832022.626106:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788832022.626117:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788832022.626129:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788832022.626142:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788832022.626155:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788832022.626167:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788832022.626181:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788832022.626192:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788832022.626205:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788832022.626233:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788832022.626248:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788832022.626259:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788832022.626269:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788832022.626282:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788832022.626295:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788832022.626307:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788832022.626319:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788832022.626334:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788832022.626346:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788832022.626360:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788832022.626373:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788832022.626386:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1788832022.626511:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059861ff1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218305280:0@lo:502: 00000100:00100000:2.0:1788832022.626561:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832022.626589:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000605fc85d going to sleep for 11 seconds 00000100:00100000:0.0:1788832022.626648:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218305280 00000100:00100000:0.0:1788832022.626654:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218305280 00000100:00100000:0.0:1788832022.626684:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788832022.626691:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ae8fd27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+15:7454:x1875726218305280:12345-0@lo:502: 00000100:00100000:0.0:1788832022.626769:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ae8fd27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+15:7454:x1875726218305280:12345-0@lo:502: Request processed in 79us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832022.626776:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788832022.626867:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059861ff1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218305280:0@lo:502: 00000040:00080000:2.0:1788832022.626905:0:7454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788832022.626911:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000100:00100000:3.0:1788832022.629724:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8e69e5b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1875726218304768:12345-0@lo:41: Request processed in 5557us (7713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832022.629740:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788832022.630120:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000059bc9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218304768:0@lo:41: 00000020:01000004:2.0:1788832022.638822:0:7473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788832022.638841:0:7473:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000005e00dfd8) 00000020:00000080:2.0:1788832022.638863:0:7473:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788832022.638991:0:7473:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c6c011bd from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788832022.638995:0:7473:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c6c011bd from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788832022.638997:0:7473:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c6c011bd 3 00010000:00080000:2.0:1788832022.639034:0:7473:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009cb7a0a7@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1788832022.641418:0:7473:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1788832022.641766:0:7473:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788832022.641821:0:7473:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788832022.641835:0:7473:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x998c12b283536c67 00000100:00080000:2.0:1788832022.641845:0:7473:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788832022.641850:0:7473:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000009cb7a0a7 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788832022.641895:0:7473:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000059861ff1 x1875726218305408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788832022.641927:0:7473:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788832022.642204:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059861ff1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875726218305408:0@lo:38: 00000100:00100000:0.0:1788832022.642273:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832022.642512:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218305408 00000100:00100000:1.0:1788832022.642520:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218305408 00000100:00100000:1.0:1788832022.642565:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788832022.642571:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000537ddfa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1875726218305408:12345-0@lo:38: 00010000:00080000:1.0:1788832022.642596:0:6527:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:1.0:1788832022.642649:0:6527:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x998c12b283536c6e 00000004:00100000:1.0:1788832022.642664:0:6527:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788832022.642843:0:6527:0:(import.c:65:import_set_state_nolock()) 00000000cb8c6ed7 : changing import state from RECOVER to FULL 00000040:00080000:0.0:1788832022.643131:0:7473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:1.0:1788832022.643283:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000537ddfa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875726218305408:12345-0@lo:38: Request processed in 709us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832022.643292:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:0.0:1788832022.643727:0:7454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788832022.643760:0:7454:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788832022.643784:0:7454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 00000000c6f68271/0x998c12b283536c52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536c59 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.643795:0:7454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 00000000c6f68271/0x998c12b283536c52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536c59 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788832022.643854:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788832022.643857:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788832022.643858:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832022.643860:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832022.643861:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832022.643867:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832022.643868:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788832022.643869:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788832022.643871:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788832022.643872:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832022.643873:0:7454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788832022.643876:0:7454:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1788832022.643878:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788832022.643879:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788832022.643880:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832022.643880:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832022.643881:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832022.643883:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832022.643883:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788832022.643884:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788832022.643885:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788832022.643886:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832022.643886:0:7454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788832022.643909:0:7454:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788832022.643925:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000076d7e098 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218305536:0@lo:253: 00000100:00100000:0.0:1788832022.643984:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832022.644013:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ed75f20e going to sleep for 11 seconds 40000000:00080000:0.0:1788832022.644065:0:7474:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00010000:00080000:2.0:1788832022.646361:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000059861ff1 x1875726218305408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788832032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832022.646377:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788832022.646386:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788832022.646394:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788832022.646399:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788832022.646403:0:3650:0:(import.c:65:import_set_state_nolock()) 000000009cb7a0a7 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788832022.646409:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059861ff1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875726218305408:0@lo:38: 00000100:00100000:2.0:1788832022.646465:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218305536 00000100:00100000:2.0:1788832022.646474:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218305536 00000100:00100000:2.0:1788832022.646525:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788832022.646532:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001dbe296b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+15:7454:x1875726218305536:12345-0@lo:253: 20000000:01000000:2.0:1788832022.646785:0:6518:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788832022.646801:0:6518:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788832022.654531:0:6504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788832022.656548:0:6518:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788832022.656604:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788832022.657188:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001dbe296b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+15:7454:x1875726218305536:12345-0@lo:253: Request processed in 10652us (13200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832022.657203:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788832022.657305:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000076d7e098 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:7454:1875726218305536:0@lo:253: 10000000:01000000:0.0:1788832022.657318:0:7454:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788832022.657321:0:7454:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788832022.657323:0:7454:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788832022.657325:0:7454:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832022.657326:0:7454:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832022.657327:0:7454:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832022.657328:0:7454:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832022.657329:0:7454:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788832022.657331:0:7454:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788832022.657332:0:7454:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788832022.657334:0:7454:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832022.657335:0:7454:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788832022.657364:0:7454:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788832022.665924:0:6541:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788832022.665935:0:6541:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788832022.665971:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000092f90d3a/0x998c12b283536c75 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.665991:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000034daf608/0x998c12b283536b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536b8e expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.665998:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000091a2b1bd/0x998c12b283536c3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536c36 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.666005:0:6541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000092f90d3a/0x998c12b283536c75 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.666048:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000091a2b1bd/0x998c12b283536c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536c36 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.666086:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000091a2b1bd/0x998c12b283536c3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536c36 expref: 14 pid: 6518 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832022.666101:0:6541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000750f164f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1875726218305664:0@lo:104: 00000100:00100000:3.0:1788832022.666164:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788832022.666219:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000034daf608/0x998c12b283536b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536b8e expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.666226:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000034daf608/0x998c12b283536b95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536b8e expref: 14 pid: 6519 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832022.666234:0:6541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000125fe0f9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1875726218305792:0@lo:104: 00000100:00100000:3.0:1788832022.666270:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832022.666289:0:6541:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c15b7651 going to sleep for 11 seconds 00000100:00100000:0.0:1788832022.666824:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218305664 00000100:00100000:0.0:1788832022.666832:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218305664 00000100:00100000:0.0:1788832022.666865:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218305792 00000100:00100000:0.0:1788832022.666868:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218305792 00000100:00100000:0.0:1788832022.666882:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788832022.666890:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001afca9a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+4:6541:x1875726218305664:12345-0@lo:104: 00010000:00010000:0.0:1788832022.666904:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 0000000036ff4be4/0x998c12b283536c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536c3d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.666975:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788832022.666981:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001afca9a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+4:6541:x1875726218305664:12345-0@lo:104: Request processed in 92us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832022.666989:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788832022.667006:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788832022.667012:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b654a2d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+3:6541:x1875726218305792:12345-0@lo:104: 00010000:00010000:0.0:1788832022.667019:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 00000000e5c50d52/0x998c12b283536b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536b95 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667052:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788832022.667056:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b654a2d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+3:6541:x1875726218305792:12345-0@lo:104: Request processed in 46us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832022.667062:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788832022.667085:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788832022.667090:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 0000000036ff4be4/0x998c12b283536c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536c3d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667097:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000036ff4be4 already unused, calling callback (00000000954f4257) 10000000:00010000:0.0:1788832022.667100:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 0000000036ff4be4/0x998c12b283536c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536c3d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667116:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 0000000036ff4be4/0x998c12b283536c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536c3d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832022.667123:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 0000000036ff4be4/0x998c12b283536c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536c3d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832022.667128:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788832022.667157:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 0000000036ff4be4/0x998c12b283536c36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536c3d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667164:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832022.667180:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 0000000036ff4be4/0x998c12b283536c36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536c3d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667187:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 0000000036ff4be4/0x998c12b283536c36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536c3d expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667198:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832022.667200:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 00000000e5c50d52/0x998c12b283536b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536b95 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667205:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e5c50d52 already unused, calling callback (00000000954f4257) 10000000:00010000:0.0:1788832022.667207:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 00000000e5c50d52/0x998c12b283536b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536b95 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667213:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 00000000e5c50d52/0x998c12b283536b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536b95 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832022.667219:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 00000000e5c50d52/0x998c12b283536b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536b95 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832022.667230:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788832022.667244:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 00000000e5c50d52/0x998c12b283536b8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536b95 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667249:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832022.667260:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 00000000e5c50d52/0x998c12b283536b8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536b95 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667265:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 00000000e5c50d52/0x998c12b283536b8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536b95 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667276:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832022.667277:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832022.667278:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832022.667283:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832022.667297:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000076d7e098 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218305920:0@lo:103: 00000100:00100000:0.0:1788832022.667327:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832022.667364:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad8e51aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218306048:0@lo:103: 00000100:00100000:0.0:1788832022.667389:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832022.667419:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218305920 00000100:00100000:0.0:1788832022.667423:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218305920 00010000:00010000:0.0:1788832022.667439:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000091a2b1bd/0x998c12b283536c3d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536c36 expref: 15 pid: 6518 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832022.667456:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218306048 00000100:00100000:0.0:1788832022.667459:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218306048 00010000:00010000:0.0:1788832022.667467:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000034daf608/0x998c12b283536b95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536b8e expref: 16 pid: 6519 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832022.667497:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788832022.667503:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004db71db2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+16:3652:x1875726218305920:12345-0@lo:103: 00010000:00010000:0.0:1788832022.667513:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832022.667517:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000091a2b1bd/0x998c12b283536c3d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536c36 expref: 16 pid: 6518 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667526:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000091a2b1bd/0x998c12b283536c3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536c36 expref: 16 pid: 6518 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667541:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832022.667583:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004db71db2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+16:3652:x1875726218305920:12345-0@lo:103: Request processed in 81us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832022.667590:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788832022.667601:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788832022.667606:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c158b077 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+15:3653:x1875726218306048:12345-0@lo:103: 00010000:00010000:0.0:1788832022.667612:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832022.667615:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000034daf608/0x998c12b283536b95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536b8e expref: 15 pid: 6519 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667638:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000034daf608/0x998c12b283536b95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536b8e expref: 15 pid: 6519 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667648:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000092f90d3a/0x998c12b283536c75 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667655:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000092f90d3a/0x998c12b283536c75 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788832022.667678:0:6511:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001902355s 00010000:00010000:0.0:1788832022.667681:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000092f90d3a/0x998c12b283536c75 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667687:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000092f90d3a/0x998c12b283536c75 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667699:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000092f90d3a/0x998c12b283536c75 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667704:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000092f90d3a/0x998c12b283536c75 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667709:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000092f90d3a already unused, calling callback (000000002a293869) 00010000:00010000:0.0:1788832022.667712:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000092f90d3a/0x998c12b283536c75 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667719:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000092f90d3a/0x998c12b283536c75 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667726:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000092f90d3a/0x998c12b283536c75 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832022.667733:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832022.667759:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c158b077 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+15:3653:x1875726218306048:12345-0@lo:103: Request processed in 153us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832022.667765:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788832022.667825:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000076d7e098 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218305920:0@lo:103: 00000100:00100000:0.0:1788832022.667926:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad8e51aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218306048:0@lo:103: 00080000:10000000:1.0:1788832022.668874:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1788832022.669062:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788832022.669290:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788832022.669473:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788832022.669688:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788832022.669849:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:3.0:1788832022.670530:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000091a2b1bd/0x998c12b283536c3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536c36 expref: 14 pid: 6518 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832022.670548:0:6541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000750f164f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1875726218305664:0@lo:104: 00010000:00010000:3.0:1788832022.670574:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000034daf608/0x998c12b283536b95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536b8e expref: 13 pid: 6519 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832022.670584:0:6541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000125fe0f9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1875726218305792:0@lo:104: 00010000:00010000:3.0:1788832022.670617:0:6541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000092f90d3a/0x998c12b283536c75 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.670646:0:6541:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000092f90d3a/0x998c12b283536c75 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.670663:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000092f90d3a/0x998c12b283536c75 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832022.670669:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000092f90d3a/0x998c12b283536c75 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788832022.672961:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788832022.673199:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788832022.673386:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1788832022.673830:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788832022.674039:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1788832022.674198:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1788832022.679863:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788832022.680053:0:7478:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788832022.680057:0:7478:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788832022.680818:0:7479:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:1.0:1788832022.680879:0:7479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aeab81d8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7479:1875726218306176:0@lo:700: 00000100:00100000:1.0:1788832022.680970:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832022.681012:0:7479:0:(client.c:2715:ptlrpc_set_wait()) set 000000001776e5a9 going to sleep for 11 seconds 00000040:01000000:2.0:1788832022.681655:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1788832022.682437:0:7480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059861ff1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1875726218306304:0@lo:1000: 00000100:00100000:2.0:1788832022.682496:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832022.682541:0:7480:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ecdd8630 going to sleep for 11 seconds 00000100:00100000:3.0:1788832022.683288:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218306176 00000100:00100000:3.0:1788832022.683299:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218306176 00000100:00100000:3.0:1788832022.683352:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788832022.683361:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9f75b85 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7479:x1875726218306176:12345-0@lo:700: 00000100:00100000:0.0:1788832022.683668:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218306304 00000100:00100000:0.0:1788832022.683673:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218306304 00000100:00100000:0.0:1788832022.683706:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788832022.683713:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be1a4f84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7480:x1875726218306304:12345-0@lo:1000: 00000100:00100000:0.0:1788832022.683814:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be1a4f84 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7480:x1875726218306304:12345-0@lo:1000: Request processed in 102us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832022.683821:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788832022.683869:0:7480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059861ff1 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1875726218306304:0@lo:1000: 00000040:01000000:0.0:1788832022.683903:0:7480:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1788832022.683938:0:7480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad8e51aa pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1875726218306432:0@lo:700: 00000100:00100000:0.0:1788832022.683982:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832022.684002:0:7480:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ed75f20e going to sleep for 11 seconds 00000100:00100000:3.0:1788832022.684105:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218306432 00000100:00100000:3.0:1788832022.684110:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218306432 00000100:00100000:3.0:1788832022.684142:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788832022.684149:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076d7e098 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7480:x1875726218306432:12345-0@lo:700: 00000100:00100000:3.0:1788832022.684199:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076d7e098 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7480:x1875726218306432:12345-0@lo:700: Request processed in 51us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832022.684206:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788832022.684374:0:7480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad8e51aa pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1875726218306432:0@lo:700: 00000100:00100000:0.0:1788832022.684419:0:7480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad8e51aa pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7480:1875726218306560:0@lo:900: 00000100:00100000:0.0:1788832022.684446:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832022.684469:0:7480:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ed75f20e going to sleep for 11 seconds 00000100:00100000:3.0:1788832022.684535:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218306560 00000100:00100000:3.0:1788832022.684539:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218306560 00000100:00100000:3.0:1788832022.684612:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788832022.684673:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057085c3e pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7480:x1875726218306560:12345-0@lo:900: 00000100:00100000:3.0:1788832022.684722:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057085c3e pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7480:x1875726218306560:12345-0@lo:900: Request processed in 104us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832022.684728:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788832022.684790:0:7480:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ad8e51aa x1875726218306560/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788832038 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832022.684801:0:7480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad8e51aa pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7480:1875726218306560:0@lo:900: 00000100:00100000:0.0:1788832022.684889:0:7480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad8e51aa pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1875726218306688:0@lo:1000: 00000100:00100000:0.0:1788832022.684927:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832022.684951:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218306688 00000100:00100000:0.0:1788832022.684963:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218306688 00000100:00100000:0.0:1788832022.684988:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788832022.684993:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db6ef2f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7480:x1875726218306688:12345-0@lo:1000: 00000100:00100000:0.0:1788832022.685049:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db6ef2f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7480:x1875726218306688:12345-0@lo:1000: Request processed in 55us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832022.685055:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788832022.685072:0:7480:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cb31c274 going to sleep for 11 seconds 00000100:00100000:0.0:1788832022.685084:0:7480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad8e51aa pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1875726218306688:0@lo:1000: 00000004:00080000:0.0:1788832022.685123:0:7480:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000ed75f20e with version 0 00000020:00100000:0.0:1788832022.685136:0:7480:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788832022.685141:0:7480:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ad8e51aa x1875726218306944/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788832022.685152:0:7480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad8e51aa pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1875726218306944:0@lo:1000: 00000100:00100000:0.0:1788832022.685175:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832022.685193:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218306944 00000100:00100000:0.0:1788832022.685197:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218306944 00000100:00100000:0.0:1788832022.685216:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788832022.685221:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000681c7b24 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7480:x1875726218306944:12345-0@lo:1000: 00000100:00100000:0.0:1788832022.685523:0:7480:0:(client.c:2715:ptlrpc_set_wait()) set 0000000015a1e5e0 going to sleep for 11 seconds 00000040:01000000:1.0:1788832022.686022:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788832022.686129:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788832022.686539:0:7454:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788832022.686545:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788832022.686810:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788832022.688934:0:7454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788832022.689526:0:7454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788832022.690980:0:7454:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000001:00080000:3.0:1788832022.692409:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1788832022.692595:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000681c7b24 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7480:x1875726218306944:12345-0@lo:1000: Request processed in 7370us (7415us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788832022.692609:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 40000000:02000000:0.0:1788832022.692686:0:6532:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:00080000:1.0:1788832022.696367:0:7454:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788832022.696614:0:7454:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788832022.697292:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788832022.697445:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788832022.697706:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788832022.697869:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788832022.698042:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788832022.698233:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788832022.698362:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788832022.698494:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788832022.698688:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788832022.698834:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00000004:00080000:3.0:1788832022.699120:0:7480:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788832022.699128:0:7480:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788832022.699148:0:7480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad8e51aa pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1875726218306944:0@lo:1000: 00000100:00100000:3.0:1788832022.699255:0:7480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000125fe0f9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1875726218307072:0@lo:1000: 00000100:00100000:3.0:1788832022.699329:0:7480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832022.699386:0:7480:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd95e9d9 going to sleep for 11 seconds 00000100:00100000:2.0:1788832022.699677:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218307072 00000100:00100000:2.0:1788832022.699686:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218307072 00000100:00100000:2.0:1788832022.699740:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788832022.699749:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000750f164f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7480:x1875726218307072:12345-0@lo:1000: 00000100:00100000:2.0:1788832022.699834:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000750f164f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7480:x1875726218307072:12345-0@lo:1000: Request processed in 86us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832022.699842:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788832022.699927:0:7480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000125fe0f9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7480:1875726218307072:0@lo:1000: 00000040:00080000:3.0:1788832022.699951:0:7480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788832022.699993:0:7480:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000ef02d6b2 with version 1 00000040:00080000:3.0:1788832022.702127:0:7480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788832022.702240:0:7480:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788832022.702420:0:7470:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000053b3aa35 version 1 rpc_version 1 00000020:00100000:2.0:1788832022.702473:0:7470:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788832022.702483:0:7470:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000f9840ee3 x1875726218307328/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788832022.702511:0:7470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9840ee3 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7470:1875726218307328:0@lo:1000: 00000100:00100000:2.0:1788832022.702594:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832022.702657:0:7470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fae1b348 going to sleep for 11 seconds 00000100:00100000:3.0:1788832022.703726:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218307328 00000100:00100000:3.0:1788832022.703739:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218307328 00100000:10000000:1.0:1788832022.703992:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788832022.704240:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788832022.704409:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788832022.704584:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788832022.704746:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788832022.704887:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788832022.705217:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788832022.705366:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788832022.705504:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788832022.705692:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788832022.705836:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788832022.706032:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788832022.706179:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788832022.706356:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788832022.706489:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788832022.706712:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788832022.706851:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00000100:00100000:3.0:1788832022.707035:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788832022.707056:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000097d0d55 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875726218307328:12345-0@lo:1000: 00000100:00100000:0.0:1788832022.707760:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9f75b85 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7479:x1875726218306176:12345-0@lo:700: Request processed in 24399us (26790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832022.707776:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788832022.707977:0:7479:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000aeab81d8 x1875726218306176/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788832038 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832022.707993:0:7479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aeab81d8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7479:1875726218306176:0@lo:700: 40000000:02000000:3.0:1788832022.708004:0:7479:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:1.0:1788832022.711897:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788832022.712123:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788832022.712267:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788832022.712398:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788832022.712565:0:7454:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788832022.712806:0:7454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788832022.724119:0:7454:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788832022.724160:0:7454:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb56201c13988 00100000:10000000:2.0:1788832022.724168:0:7454:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000001:00080000:2.0:1788832022.725385:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000020:01000004:1.0:1788832022.725793:0:7454:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788832022.725823:0:7454:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788832022.725840:0:7454:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788832022.725855:0:7454:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788832022.726514:0:7454:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788832022.733248:0:7454:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:0.0:1788832022.735574:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000097d0d55 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875726218307328:12345-0@lo:1000: Request processed in 28518us (32971us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788832022.735592:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1788832022.735687:0:7470:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788832022.735691:0:7470:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788832022.735707:0:7470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9840ee3 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7470:1875726218307328:0@lo:1000: 00000040:00080000:2.0:1788832022.755790:0:7479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788832022.761683:0:7479:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788832022.761769:0:7479:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788832022.761774:0:7479:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1788832022.998996:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832024.023390:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832025.049373:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832026.070788:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832027.098755:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788832027.334871:0:7725:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788832027.867638:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005e2ea639 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218307840:0@lo:400: 00000100:00100000:1.0:1788832027.867777:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832027.867841:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788832027.867847:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000083846902 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218307456:0@lo:400: 00000100:00100000:1.0:1788832027.867877:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832027.867907:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000042284f51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218307584:0@lo:400: 00000100:00100000:1.0:1788832027.867943:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832027.867960:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788832027.867964:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c49ee30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218307712:0@lo:400: 00000100:00100000:1.0:1788832027.867988:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832027.868019:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218307840 00000100:00100000:1.0:1788832027.868027:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218307840 00000100:00100000:1.0:1788832027.868065:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218307584 00000100:00100000:1.0:1788832027.868068:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218307584 00000100:00100000:1.0:1788832027.868084:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788832027.868092:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0d7474b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218307840:12345-0@lo:400: 00000100:00100000:1.0:1788832027.868139:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0d7474b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218307840:12345-0@lo:400: Request processed in 48us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832027.868146:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788832027.868163:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788832027.868168:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088051904 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218307584:12345-0@lo:400: 00000100:00100000:1.0:1788832027.868194:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088051904 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218307584:12345-0@lo:400: Request processed in 26us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832027.868200:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788832027.868215:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218307456 00000100:00100000:1.0:1788832027.868219:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218307456 00000100:00100000:1.0:1788832027.868238:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788832027.868244:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ba71c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+13:3653:x1875726218307456:12345-0@lo:400: 00000100:00100000:1.0:1788832027.868279:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ba71c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+13:3653:x1875726218307456:12345-0@lo:400: Request processed in 36us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832027.868285:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788832027.868328:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000042284f51 x1875726218307584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832027.868342:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000042284f51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218307584:0@lo:400: 00000100:00100000:1.0:1788832027.868363:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000083846902 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218307456:0@lo:400: 00010000:00080000:1.0:1788832027.868371:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000005e2ea639 x1875726218307840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832027.868379:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005e2ea639 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218307840:0@lo:400: 00000100:00100000:2.0:1788832027.868753:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218307712 00000100:00100000:2.0:1788832027.868758:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218307712 00000100:00100000:2.0:1788832027.868786:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788832027.868793:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aeab81d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218307712:12345-0@lo:400: 00000100:00100000:2.0:1788832027.868836:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aeab81d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218307712:12345-0@lo:400: Request processed in 44us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832027.868842:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788832027.868869:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c49ee30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218307712:0@lo:400: 00000100:00100000:3.0:1788832027.868975:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788832027.868986:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0a2cc75 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218307968:0@lo:41: 00000100:00100000:3.0:1788832027.869022:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832027.869183:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218307968 00000100:00100000:2.0:1788832027.869187:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218307968 00000100:00100000:2.0:1788832027.869216:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788832027.869222:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000125fe0f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218307968:12345-0@lo:41: 00000004:00000024:2.0:1788832027.869244:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788832027.869281:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000125fe0f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218307968:12345-0@lo:41: Request processed in 60us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832027.869288:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788832027.869321:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0a2cc75 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218307968:0@lo:41: 00010000:00010000:1.0:1788832028.124809:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788832028.510958:0:7777:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788832028.511244:0:7777:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788832029.144292:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832030.167102:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832031.192183:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788832031.328315:0:7879:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788832031.328589:0:7879:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788832032.214760:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788832032.425118:0:7927:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdae012040 20000000:00000080:2.0:1788832032.425138:0:7927:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d2c3e6cf800 uarg=0000000000000000 20000000:01000000:2.0:1788832032.425184:0:7927:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788832032.425191:0:7927:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788832032.425196:0:7927:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788832032.426834:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788832032.426855:0:7927:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788832032.433176:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788832032.433425:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788832032.433459:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788832032.433477:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788832032.434646:0:7927:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788832032.434739:0:7927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002ef8c5da/0x998c12b283536c7c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.434759:0:7927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000067ab0cac/0x998c12b283536b5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536b56 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.434766:0:7927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ff97bcfb/0x998c12b283536c4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536c44 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.434773:0:7927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002ef8c5da/0x998c12b283536c7c lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.434814:0:7927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ff97bcfb/0x998c12b283536c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536c44 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.434830:0:7927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ff97bcfb/0x998c12b283536c4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536c44 expref: 12 pid: 6519 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832032.434843:0:7927:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0a2cc75 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1875726218308096:0@lo:104: 00000100:00100000:2.0:1788832032.435047:0:7927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788832032.435101:0:7927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000067ab0cac/0x998c12b283536b5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536b56 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.435108:0:7927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000067ab0cac/0x998c12b283536b5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536b56 expref: 12 pid: 6518 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832032.435116:0:7927:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000af34f72f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1875726218308224:0@lo:104: 00000100:00100000:2.0:1788832032.435134:0:7927:0:(client.c:2715:ptlrpc_set_wait()) set 00000000294b8160 going to sleep for 11 seconds 00000100:00100000:1.0:1788832032.435395:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788832032.435417:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832032.435455:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218308096 00000100:00100000:1.0:1788832032.435462:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218308096 00000100:00100000:1.0:1788832032.435497:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218308224 00000100:00100000:1.0:1788832032.435500:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218308224 00000100:00100000:1.0:1788832032.435513:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788832032.435520:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff7d345c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+4:7927:x1875726218308096:12345-0@lo:104: 00010000:00010000:1.0:1788832032.435542:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 00000000d2639d0c/0x998c12b283536c44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536c4b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.435612:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788832032.435636:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff7d345c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+4:7927:x1875726218308096:12345-0@lo:104: Request processed in 98us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832032.435645:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788832032.435686:0:7927:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0a2cc75 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1875726218308096:0@lo:104: 00000100:00100000:1.0:1788832032.435689:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788832032.435702:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e2ea639 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+3:7927:x1875726218308224:12345-0@lo:104: 00010000:00010000:1.0:1788832032.435710:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: 00000000f82b0de2/0x998c12b283536b56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536b5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.435756:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788832032.435762:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e2ea639 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+3:7927:x1875726218308224:12345-0@lo:104: Request processed in 63us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832032.435767:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788832032.435789:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788832032.435795:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 00000000d2639d0c/0x998c12b283536c44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536c4b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832032.435799:0:7927:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000af34f72f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1875726218308224:0@lo:104: 00010000:00010000:1.0:1788832032.435809:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d2639d0c already unused, calling callback (00000000954f4257) 10000000:00010000:1.0:1788832032.435813:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 00000000d2639d0c/0x998c12b283536c44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536c4b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.435821:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 00000000d2639d0c/0x998c12b283536c44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536c4b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832032.435825:0:7927:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002ef8c5da/0x998c12b283536c7c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788832032.435831:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 00000000d2639d0c/0x998c12b283536c44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536c4b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832032.435845:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788832032.435884:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 00000000d2639d0c/0x998c12b283536c44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536c4b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.435902:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788832032.435928:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 00000000d2639d0c/0x998c12b283536c44 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536c4b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.435935:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 00000000d2639d0c/0x998c12b283536c44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536c4b expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.435949:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832032.435952:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: 00000000f82b0de2/0x998c12b283536b56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536b5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.435958:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f82b0de2 already unused, calling callback (00000000954f4257) 00000100:00100000:3.0:1788832032.435960:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000083846902 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218308352:0@lo:103: 10000000:00010000:1.0:1788832032.435962:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: 00000000f82b0de2/0x998c12b283536b56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536b5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832032.435972:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 00010000:00010000:1.0:1788832032.435973:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: 00000000f82b0de2/0x998c12b283536b56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536b5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832032.435978:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d2c39185800 from 4 10000000:01000000:2.0:1788832032.435984:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 10000000:00010000:1.0:1788832032.435986:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: 00000000f82b0de2/0x998c12b283536b56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536b5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832032.435993:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788832032.436002:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788832032.436011:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 000000001124fa48/0x998c12b283536c83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.436011:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: 00000000f82b0de2/0x998c12b283536b56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536b5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.436029:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 000000001124fa48/0x998c12b283536c83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.436031:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832032.436040:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 000000001124fa48/0x998c12b283536c83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832032.436054:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008948275c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218308480:0@lo:101: 00010000:00010000:1.0:1788832032.436064:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: 00000000f82b0de2/0x998c12b283536b56 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536b5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.436073:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: 00000000f82b0de2/0x998c12b283536b56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536b5d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832032.436087:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788832032.436089:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832032.436093:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832032.436095:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832032.436103:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832032.436104:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set 0000000021764578 going to sleep for 11 seconds 00000100:00100000:3.0:1788832032.436110:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832032.436121:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000042284f51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218308608:0@lo:103: 00000100:00100000:2.0:1788832032.436124:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218308480 00000100:00100000:2.0:1788832032.436129:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218308480 00000100:00100000:3.0:1788832032.436153:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832032.436235:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788832032.436243:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f24c324 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+13:6522:x1875726218308480:12345-0@lo:101: 00010000:00010000:2.0:1788832032.436255:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832032.436267:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bb583b27/0x998c12b283536c8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536c83 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.436292:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bb583b27/0x998c12b283536c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536c83 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.436301:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bb583b27/0x998c12b283536c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536c83 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.436309:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bb583b27, rc 0) 00000100:00100000:2.0:1788832032.436342:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f24c324 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+14:6522:x1875726218308480:12345-0@lo:101: Request processed in 101us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832032.436349:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788832032.437050:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218308352 00000100:00100000:0.0:1788832032.437059:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218308352 00010000:00010000:0.0:1788832032.437085:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ff97bcfb/0x998c12b283536c4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536c44 expref: 14 pid: 6519 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832032.437112:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218308608 00000100:00100000:0.0:1788832032.437116:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218308608 00010000:00010000:0.0:1788832032.437126:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000067ab0cac/0x998c12b283536b5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536b56 expref: 15 pid: 6518 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832032.437144:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788832032.437151:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0e61a98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+15:3651:x1875726218308352:12345-0@lo:103: 00010000:00010000:0.0:1788832032.437162:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832032.437167:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ff97bcfb/0x998c12b283536c4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536c44 expref: 15 pid: 6519 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832032.437178:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ff97bcfb/0x998c12b283536c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536c44 expref: 15 pid: 6519 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832032.437192:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ff97bcfb/0x998c12b283536c4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536c44 expref: 15 pid: 6519 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832032.437203:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832032.437249:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0e61a98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+14:3651:x1875726218308352:12345-0@lo:103: Request processed in 99us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832032.437256:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788832032.437278:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788832032.437283:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000822c2d2d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+13:3651:x1875726218308608:12345-0@lo:103: 00010000:00010000:0.0:1788832032.437290:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832032.437294:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000067ab0cac/0x998c12b283536b5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536b56 expref: 13 pid: 6518 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832032.437303:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000067ab0cac/0x998c12b283536b5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536b56 expref: 13 pid: 6518 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832032.437312:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000067ab0cac/0x998c12b283536b5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536b56 expref: 13 pid: 6518 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832032.437846:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008948275c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218308480:0@lo:101: 00010000:00010000:3.0:1788832032.437866:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 000000001124fa48/0x998c12b283536c83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536c8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832032.437875:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 000000001124fa48/0x998c12b283536c83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536c8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832032.437900:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000083846902 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218308352:0@lo:103: 00000100:00100000:3.0:1788832032.437951:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000050ef032c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218308736:0@lo:256: 00000100:00100000:3.0:1788832032.437993:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832032.438026:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set 0000000068070e28 going to sleep for 11 seconds 00010000:00010000:0.0:1788832032.438094:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002ef8c5da/0x998c12b283536c7c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832032.438099:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ef8c5da/0x998c12b283536c7c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832032.438797:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218308736 00000100:00100000:2.0:1788832032.438805:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218308736 00000100:00100000:2.0:1788832032.438856:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788832032.438865:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079ee5d11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+13:6522:x1875726218308736:12345-0@lo:256: 00010000:00010000:1.0:1788832032.438907:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002ef8c5da/0x998c12b283536c7c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.438916:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002ef8c5da/0x998c12b283536c7c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.438922:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002ef8c5da/0x998c12b283536c7c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.438928:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002ef8c5da/0x998c12b283536c7c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.438932:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002ef8c5da already unused, calling callback (000000002a293869) 00010000:00010000:1.0:1788832032.438936:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002ef8c5da/0x998c12b283536c7c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.438943:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002ef8c5da/0x998c12b283536c7c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.438964:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002ef8c5da/0x998c12b283536c7c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.438980:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 20000000:01000000:2.0:1788832032.439006:0:6518:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788832032.439025:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788832032.439028:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788832032.439032:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000822c2d2d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+13:3651:x1875726218308608:12345-0@lo:103: Request processed in 1748us (2879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832032.439047:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788832032.439166:0:7927:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002ef8c5da/0x998c12b283536c7c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832032.439175:0:7927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002ef8c5da/0x998c12b283536c7c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832032.439180:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002ef8c5da/0x998c12b283536c7c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832032.440028:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000042284f51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218308608:0@lo:103: 00000100:00100000:2.0:1788832032.440381:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079ee5d11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+12:6522:x1875726218308736:12345-0@lo:256: Request processed in 1517us (2386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832032.440391:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788832032.440587:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000050ef032c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218308736:0@lo:256: 10000000:01000000:2.0:1788832032.440662:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788832032.440671:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: 000000001124fa48/0x998c12b283536c83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536c8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.440681:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: 000000001124fa48/0x998c12b283536c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536c8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832032.440700:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788832032.440703:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2c39185800 from 1 10000000:01000000:2.0:1788832032.440705:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788832032.440735:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: 0000000036ff4be4/0x998c12b283536c91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.440813:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: 0000000036ff4be4/0x998c12b283536c91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.440823:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: 0000000036ff4be4/0x998c12b283536c91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832032.440839:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f3f8035 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218308864:0@lo:101: 00000100:00100000:2.0:1788832032.440874:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832032.440919:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set 000000000d617e0f going to sleep for 11 seconds 00000100:00100000:0.0:1788832032.440932:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218308864 00000100:00100000:0.0:1788832032.440940:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218308864 00000100:00100000:0.0:1788832032.440987:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788832032.440995:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009dc7d64a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+12:6522:x1875726218308864:12345-0@lo:101: 00010000:00010000:0.0:1788832032.441007:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832032.441020:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000055beffee/0x998c12b283536c98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536c91 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832032.441042:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000055beffee/0x998c12b283536c98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536c91 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832032.441053:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000055beffee/0x998c12b283536c98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536c91 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832032.441066:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000055beffee, rc 0) 00000100:00100000:0.0:1788832032.441096:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009dc7d64a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+13:6522:x1875726218308864:12345-0@lo:101: Request processed in 103us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832032.441101:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788832032.441169:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f3f8035 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218308864:0@lo:101: 00010000:00010000:2.0:1788832032.441179:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: 0000000036ff4be4/0x998c12b283536c91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536c98 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.441186:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: 0000000036ff4be4/0x998c12b283536c91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536c98 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832032.441236:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f3f8035 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218308992:0@lo:501: 00000100:00100000:2.0:1788832032.441260:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832032.441274:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set 000000000d617e0f going to sleep for 11 seconds 00000100:00100000:2.0:1788832032.441285:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218308992 00000100:00100000:2.0:1788832032.441289:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218308992 00000100:00100000:2.0:1788832032.441309:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788832032.441321:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006761ff3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+13:6522:x1875726218308992:12345-0@lo:501: 00000100:00100000:2.0:1788832032.441418:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006761ff3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+13:6522:x1875726218308992:12345-0@lo:501: Request processed in 97us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832032.441424:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788832032.441451:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f3f8035 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218308992:0@lo:501: 00000100:00100000:2.0:1788832032.441476:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f3f8035 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218309120:0@lo:503: 00000100:00100000:2.0:1788832032.441510:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832032.441522:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set 000000000d617e0f going to sleep for 11 seconds 00000100:00100000:2.0:1788832032.441533:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218309120 00000100:00100000:2.0:1788832032.441536:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218309120 00000100:00100000:2.0:1788832032.441555:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788832032.441560:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b1ddff7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+13:6522:x1875726218309120:12345-0@lo:503: 00000100:00100000:2.0:1788832032.441736:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b1ddff7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+13:6522:x1875726218309120:12345-0@lo:503: Request processed in 175us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832032.441742:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788832032.441834:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f3f8035 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218309120:0@lo:503: 00000100:00100000:1.0:1788832032.442162:0:7928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000042284f51 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:7928:1875726218309248:0@lo:502: 00000100:00100000:1.0:1788832032.442198:0:7928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832032.442591:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218309248 00000100:00100000:2.0:1788832032.442597:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218309248 00000100:00100000:1.0:1788832032.442609:0:7928:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a6ec8268 going to sleep for 11 seconds 00000100:00100000:2.0:1788832032.442675:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788832032.442682:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ee584b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+13:7928:x1875726218309248:12345-0@lo:502: 00000100:00100000:2.0:1788832032.442769:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ee584b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+13:7928:x1875726218309248:12345-0@lo:502: Request processed in 88us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832032.442777:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788832032.442858:0:7928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000042284f51 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:7928:1875726218309248:0@lo:502: 00000020:01000000:1.0:1788832032.442880:0:7928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832032.442900:0:7928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832032.442903:0:7928:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788832032.442909:0:7928:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d2c39185800 00000020:00000080:1.0:1788832032.442912:0:7928:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788832032.442950:0:7928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:7928:1875726218309376:0@lo:502: 00000100:00100000:1.0:1788832032.442982:0:7928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832032.443036:0:7928:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c028a6180 going to sleep for 11 seconds 00000100:00100000:2.0:1788832032.443072:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218309376 00000100:00100000:2.0:1788832032.443076:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218309376 00000100:00100000:2.0:1788832032.443133:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788832032.443140:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+13:7928:x1875726218309376:12345-0@lo:502: 00000100:00100000:2.0:1788832032.443210:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+13:7928:x1875726218309376:12345-0@lo:502: Request processed in 70us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832032.443216:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788832032.443268:0:7928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:7928:1875726218309376:0@lo:502: 00000020:01000000:1.0:1788832032.443285:0:7928:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832032.443289:0:7928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832032.443291:0:7928:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788832032.443294:0:7928:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788832032.443421:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788832032.443440:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788832032.443449:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c4204b000/0x998c12b283536c91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536c98 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.443459:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c4204b000/0x998c12b283536c91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536c98 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832032.443468:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788832032.443470:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d2c40623800 from 21 10000000:01000000:2.0:1788832032.443472:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788832032.443506:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd400/0x998c12b283536c9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.443515:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd400/0x998c12b283536c9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.443525:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd400/0x998c12b283536c9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832032.443538:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218309504:0@lo:101: 00000100:00100000:2.0:1788832032.443565:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832032.443617:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36c2de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788832032.443691:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218309504 00000100:00100000:1.0:1788832032.443696:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218309504 00000100:00100000:1.0:1788832032.443764:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788832032.443771:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+13:6522:x1875726218309504:12345-0@lo:101: 00010000:00010000:1.0:1788832032.443780:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832032.443791:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c390f2a00/0x998c12b283536ca6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536c9f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.443810:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c390f2a00/0x998c12b283536ca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536c9f expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.443819:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c390f2a00/0x998c12b283536ca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536c9f expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.443827:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c390f2a00, rc 0) 00000100:00100000:1.0:1788832032.443858:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+14:6522:x1875726218309504:12345-0@lo:101: Request processed in 88us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832032.443863:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788832032.443918:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218309504:0@lo:101: 00010000:00010000:2.0:1788832032.443930:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd400/0x998c12b283536c9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536ca6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.443949:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd400/0x998c12b283536c9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536ca6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832032.443999:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218309632:0@lo:501: 00000100:00100000:2.0:1788832032.444023:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832032.444042:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36c2de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832032.444053:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218309632 00000100:00100000:2.0:1788832032.444056:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218309632 00000100:00100000:2.0:1788832032.444072:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788832032.444077:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+14:6522:x1875726218309632:12345-0@lo:501: 00000100:00100000:2.0:1788832032.444173:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+14:6522:x1875726218309632:12345-0@lo:501: Request processed in 94us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832032.444179:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788832032.444207:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218309632:0@lo:501: 00000100:00100000:2.0:1788832032.444229:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218309760:0@lo:503: 00000100:00100000:2.0:1788832032.444260:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832032.444272:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36c2de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832032.444282:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218309760 00000100:00100000:2.0:1788832032.444285:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218309760 00000100:00100000:2.0:1788832032.444300:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788832032.444305:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+14:6522:x1875726218309760:12345-0@lo:503: 00000100:00100000:2.0:1788832032.444370:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+14:6522:x1875726218309760:12345-0@lo:503: Request processed in 64us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832032.444376:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788832032.444409:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218309760:0@lo:503: 00000100:00100000:2.0:1788832032.444578:0:7929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:7929:1875726218309888:0@lo:502: 00000100:00100000:2.0:1788832032.444610:0:7929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832032.444658:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218309888 00000100:00100000:2.0:1788832032.444662:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218309888 00000100:00100000:2.0:1788832032.444680:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788832032.444686:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+14:7929:x1875726218309888:12345-0@lo:502: 00000100:00100000:2.0:1788832032.444758:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+14:7929:x1875726218309888:12345-0@lo:502: Request processed in 71us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832032.444765:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788832032.444798:0:7929:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36c2dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832032.444810:0:7929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:7929:1875726218309888:0@lo:502: 00000100:00100000:2.0:1788832032.444845:0:7929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:7929:1875726218310016:0@lo:502: 00000100:00100000:2.0:1788832032.444877:0:7929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832032.444909:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218310016 00000100:00100000:2.0:1788832032.444913:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218310016 00000100:00100000:2.0:1788832032.444930:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788832032.444936:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+14:7929:x1875726218310016:12345-0@lo:502: 00000100:00100000:2.0:1788832032.444990:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+14:7929:x1875726218310016:12345-0@lo:502: Request processed in 54us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832032.444996:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788832032.445022:0:7929:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36c2dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832032.445033:0:7929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:7929:1875726218310016:0@lo:502: 00000040:00080000:2.0:1788832032.445052:0:7929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788832032.445092:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788832032.445107:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788832032.445116:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd400/0x998c12b283536c9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536ca6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.445130:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd400/0x998c12b283536c9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536ca6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832032.445139:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788832032.445141:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d2c40623800 from 4 10000000:01000000:2.0:1788832032.445143:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788832032.445161:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc400/0x998c12b283536cad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.445168:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc400/0x998c12b283536cad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.445177:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc400/0x998c12b283536cad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832032.445186:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218310144:0@lo:101: 00000100:00100000:2.0:1788832032.445216:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832032.445228:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36c2dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832032.445239:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218310144 00000100:00100000:2.0:1788832032.445242:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218310144 00000100:00100000:2.0:1788832032.445259:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788832032.445264:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+14:6522:x1875726218310144:12345-0@lo:101: 00010000:00010000:2.0:1788832032.445271:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832032.445280:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c092ddc00/0x998c12b283536cb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536cad expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.445296:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c092ddc00/0x998c12b283536cb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536cad expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.445315:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c092ddc00/0x998c12b283536cb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536cad expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.445322:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092ddc00, rc 0) 00000100:00100000:2.0:1788832032.445350:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:6522:x1875726218310144:12345-0@lo:101: Request processed in 85us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832032.445356:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788832032.445569:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218310144:0@lo:101: 00010000:00010000:2.0:1788832032.445581:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc400/0x998c12b283536cad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536cb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.445589:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc400/0x998c12b283536cad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536cb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832032.445658:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218310272:0@lo:256: 00000100:00100000:2.0:1788832032.445688:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832032.445708:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36c2dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832032.445798:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218310272 00000100:00100000:2.0:1788832032.445803:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218310272 00000100:00100000:2.0:1788832032.445865:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788832032.445872:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:6522:x1875726218310272:12345-0@lo:256: 20000000:01000000:2.0:1788832032.445885:0:6519:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788832032.445910:0:6519:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788832032.445913:0:6519:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788832032.445989:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:6522:x1875726218310272:12345-0@lo:256: Request processed in 117us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832032.445996:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788832032.446068:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218310272:0@lo:256: 10000000:01000000:2.0:1788832032.446107:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788832032.446112:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc400/0x998c12b283536cad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536cb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.446120:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc400/0x998c12b283536cad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536cb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832032.446128:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788832032.446130:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788832032.446133:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788832032.446150:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd800/0x998c12b283536cbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.446157:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd800/0x998c12b283536cbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.446165:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd800/0x998c12b283536cbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832032.446177:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218310400:0@lo:101: 00000100:00100000:2.0:1788832032.446202:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832032.446257:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0305c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788832032.446350:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218310400 00000100:00100000:1.0:1788832032.446355:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218310400 00000100:00100000:1.0:1788832032.446419:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788832032.446427:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+15:6522:x1875726218310400:12345-0@lo:101: 00010000:00010000:1.0:1788832032.446435:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832032.446446:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c390f2e00/0x998c12b283536cc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536cbb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.446462:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c390f2e00/0x998c12b283536cc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536cbb expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.446471:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c390f2e00/0x998c12b283536cc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536cbb expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.446492:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c390f2e00, rc 0) 00000100:00100000:1.0:1788832032.446526:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218310400:12345-0@lo:101: Request processed in 100us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832032.446532:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788832032.446581:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218310400:0@lo:101: 00010000:00010000:2.0:1788832032.446591:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd800/0x998c12b283536cbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536cc2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.446599:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd800/0x998c12b283536cbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536cc2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832032.446681:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218310528:0@lo:501: 00000100:00100000:2.0:1788832032.446705:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832032.446726:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0305c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788832032.446737:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218310528 00000100:00100000:2.0:1788832032.446741:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218310528 00000100:00100000:2.0:1788832032.446757:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788832032.446762:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218310528:12345-0@lo:501: 00000100:00100000:2.0:1788832032.446856:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218310528:12345-0@lo:501: Request processed in 93us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832032.446862:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788832032.446903:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218310528:0@lo:501: 00000100:00100000:2.0:1788832032.446929:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218310656:0@lo:503: 00000100:00100000:2.0:1788832032.446965:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832032.446979:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0305c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788832032.446990:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218310656 00000100:00100000:2.0:1788832032.446993:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218310656 00000100:00100000:2.0:1788832032.447009:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788832032.447014:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218310656:12345-0@lo:503: 00000100:00100000:2.0:1788832032.447085:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218310656:12345-0@lo:503: Request processed in 70us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832032.447092:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788832032.447131:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218310656:0@lo:503: 00000100:00100000:2.0:1788832032.447285:0:7930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:7930:1875726218310784:0@lo:502: 00000100:00100000:2.0:1788832032.447319:0:7930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832032.447342:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218310784 00000100:00100000:2.0:1788832032.447345:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218310784 00000100:00100000:2.0:1788832032.447362:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788832032.447368:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+16:7930:x1875726218310784:12345-0@lo:502: 00000100:00100000:2.0:1788832032.447432:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+16:7930:x1875726218310784:12345-0@lo:502: Request processed in 64us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832032.447438:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788832032.447464:0:7930:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0305c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788832032.447475:0:7930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:7930:1875726218310784:0@lo:502: 00000020:01000000:2.0:1788832032.447496:0:7930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832032.447505:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832032.447508:0:7930:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788832032.447513:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788832032.447517:0:7930:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:00000080:2.0:1788832032.447538:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788832032.447562:0:7930:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9d2c3e7799b8) 00000020:00000080:2.0:1788832032.447582:0:7930:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1788832032.447589:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788832032.447686:0:7930:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788832032.447692:0:7930:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788832032.447699:0:7930:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x998c12b283536cd0 00010000:00080000:2.0:1788832032.447728:0:7930:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2c3e676800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1788832032.452883:0:7930:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1788832032.457335:0:7930:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788832032.457350:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788832032.457397:0:7930:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788832032.457420:0:7930:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x998c12b283536cd7 00000100:00080000:1.0:1788832032.457432:0:7930:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788832032.457449:0:7930:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d2c3e676800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788832032.457485:0:7930:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c18fe7b80 x1875726218310912/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788832032.457513:0:7930:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1788832032.457572:0:7930:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1788832032.457847:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218310912:0@lo:38: 00000100:00100000:2.0:1788832032.457945:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832032.458013:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218310912 00000100:00100000:2.0:1788832032.458021:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218310912 00000100:00100000:2.0:1788832032.458057:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788832032.458066:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1875726218310912:12345-0@lo:38: 00000100:00100000:3.0:1788832032.458099:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218311040:0@lo:400: 00010000:00080000:2.0:1788832032.458101:0:6530:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000100:00100000:3.0:1788832032.458142:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788832032.458147:0:6530:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x998c12b283536cde 00000100:00100000:1.0:1788832032.458212:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788832032.458223:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218311296:0@lo:400: 00000004:00100000:2.0:1788832032.458915:0:6530:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788832032.458923:0:6530:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788832032.458968:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788832032.458979:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218311168:0@lo:400: 00000100:00100000:3.0:1788832032.459016:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832032.459095:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218311040 00000100:00100000:3.0:1788832032.459101:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218311040 00000100:00100000:3.0:1788832032.459148:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788832032.459156:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218311040:12345-0@lo:400: 00000100:00100000:3.0:1788832032.459207:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218311040:12345-0@lo:400: Request processed in 52us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832032.459215:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788832032.459507:0:6531:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788832032.459516:0:6531:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1788832032.459989:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832032.460027:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218311296 00000100:00100000:1.0:1788832032.460033:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218311296 00000100:00100000:1.0:1788832032.460066:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788832032.460074:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218311296:12345-0@lo:400: 00000100:00100000:1.0:1788832032.460117:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218311296:12345-0@lo:400: Request processed in 45us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832032.460123:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788832032.460161:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d2c182a9500 x1875726218311296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832032.460189:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218311296:0@lo:400: 00000100:00100000:0.0:1788832032.460294:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218311168 00000100:00100000:0.0:1788832032.460298:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218311168 00000100:00100000:2.0:1788832032.460444:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788832032.460452:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218311168:12345-0@lo:400: 00000100:00100000:2.0:1788832032.460488:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218311168:12345-0@lo:400: Request processed in 38us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832032.460494:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788832032.460597:0:7933:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9d2c1fe38a80 x1875726218311424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832032.460606:0:7933:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c18f3bcc0 going to sleep for 0 seconds 00000100:00100000:2.0:1788832032.460971:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218311168:0@lo:400: 00010000:00080000:2.0:1788832032.460985:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d2c182a8380 x1875726218311040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832032.460994:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218311040:0@lo:400: 00000020:01000000:1.0:1788832032.464810:0:7930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832032.464820:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832032.464822:0:7930:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788832032.464825:0:7930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832032.464829:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832032.464830:0:7930:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788832032.464833:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788832032.464834:0:7930:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788832032.464878:0:7930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:7930:1875726218311552:0@lo:502: 00000100:00100000:1.0:1788832032.464963:0:7930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832032.465000:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218311552 00000100:00100000:1.0:1788832032.465006:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218311552 00000100:00100000:1.0:1788832032.465052:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788832032.465060:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+16:7930:x1875726218311552:12345-0@lo:502: 00000100:00100000:1.0:1788832032.465165:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+16:7930:x1875726218311552:12345-0@lo:502: Request processed in 105us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832032.465171:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788832032.465218:0:7930:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c028a66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832032.465239:0:7930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:7930:1875726218311552:0@lo:502: 00000020:01000000:1.0:1788832032.465264:0:7930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832032.465268:0:7930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832032.465269:0:7930:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788832032.465273:0:7930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788832032.465322:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788832032.465339:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788832032.465349:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd800/0x998c12b283536cbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536cc2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.465365:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd800/0x998c12b283536cbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536cc2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832032.465374:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788832032.465377:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2c40623800 from 1 10000000:01000000:1.0:1788832032.465380:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788832032.465404:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2800/0x998c12b283536ce5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.465412:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2800/0x998c12b283536ce5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.465420:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2800/0x998c12b283536ce5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832032.466989:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218311680:0@lo:101: 00000100:00100000:1.0:1788832032.467052:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832032.468780:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c028a66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832032.472600:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218311680 00000100:00100000:0.0:1788832032.472615:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218311680 00000100:00100000:0.0:1788832032.472693:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788832032.472703:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218311680:12345-0@lo:101: 00010000:00010000:0.0:1788832032.472720:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832032.472738:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c00031000/0x998c12b283536cec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536ce5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832032.472764:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c00031000/0x998c12b283536cec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536ce5 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832032.472775:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c00031000/0x998c12b283536cec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536ce5 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832032.472785:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031000, rc 0) 00000100:00100000:0.0:1788832032.472853:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218311680:12345-0@lo:101: Request processed in 152us (5801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832032.472859:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788832032.475028:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218311680:0@lo:101: 00010000:00010000:1.0:1788832032.475053:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2800/0x998c12b283536ce5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536cec expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832032.475065:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2800/0x998c12b283536ce5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536cec expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832032.475142:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218311808:0@lo:501: 00000100:00100000:1.0:1788832032.475192:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832032.475229:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c028a66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832032.475267:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218311808 00000100:00100000:0.0:1788832032.475274:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218311808 00000100:00100000:0.0:1788832032.475315:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788832032.475323:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218311808:12345-0@lo:501: 00000100:00100000:0.0:1788832032.475476:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218311808:12345-0@lo:501: Request processed in 152us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832032.475483:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788832032.475492:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218311808:0@lo:501: 00000100:00100000:1.0:1788832032.475517:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218311936:0@lo:503: 00000100:00100000:1.0:1788832032.475556:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832032.475580:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c028a66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832032.478104:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218311936 00000100:00100000:0.0:1788832032.478118:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218311936 00000100:00100000:0.0:1788832032.478172:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788832032.478182:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218311936:12345-0@lo:503: 00000100:00100000:0.0:1788832032.478349:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218311936:12345-0@lo:503: Request processed in 168us (2792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832032.478357:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788832032.481081:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218311936:0@lo:503: 00000100:00100000:0.0:1788832032.483117:0:7937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe3aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:7937:1875726218312064:0@lo:502: 00000100:00100000:0.0:1788832032.483206:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832032.483253:0:7937:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c18f3b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788832032.483305:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218312064 00000100:00100000:2.0:1788832032.483313:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218312064 00000100:00100000:2.0:1788832032.483364:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788832032.483375:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+17:7937:x1875726218312064:12345-0@lo:502: 00000100:00100000:2.0:1788832032.483491:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+17:7937:x1875726218312064:12345-0@lo:502: Request processed in 118us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832032.483498:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788832032.483590:0:7937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe3aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:7937:1875726218312064:0@lo:502: 00000020:01000000:0.0:1788832032.483649:0:7937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832032.483659:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832032.483662:0:7937:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788832032.483670:0:7937:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d2c40623800 00000020:00000080:0.0:1788832032.483673:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788832032.483695:0:7937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe3aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:7937:1875726218312192:0@lo:502: 00000100:00100000:0.0:1788832032.483729:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832032.483747:0:7937:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c18f3b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788832032.483804:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218312192 00000100:00100000:2.0:1788832032.483808:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218312192 00000100:00100000:2.0:1788832032.483935:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788832032.483943:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:7937:x1875726218312192:12345-0@lo:502: 00000100:00100000:2.0:1788832032.484008:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:7937:x1875726218312192:12345-0@lo:502: Request processed in 66us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832032.484014:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1788832032.488383:0:6530:0:(import.c:65:import_set_state_nolock()) ffff9d2c36bfc800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788832032.488560:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875726218310912:12345-0@lo:38: Request processed in 30417us (30538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832032.488573:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788832032.488656:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788832032.488665:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788832032.488674:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788832032.488679:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788832032.488681:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e676800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788832032.488696:0:3650:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000129bafa): req@ffff9d2c1fe38a80 x1875726218311424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832032.488720:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218310912:0@lo:38: 00000100:00100000:3.0:1788832032.488778:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832032.488798:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218312320:0@lo:41: 00000100:00100000:3.0:1788832032.488836:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832032.488879:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218312320 00000100:00100000:3.0:1788832032.488884:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218312320 00000100:00100000:3.0:1788832032.488937:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788832032.488946:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1875726218312320:12345-0@lo:41: 00000004:00000024:3.0:1788832032.488971:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788832032.489008:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1875726218312320:12345-0@lo:41: Request processed in 64us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832032.489013:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788832032.489043:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218312320:0@lo:41: 00000100:00100000:0.0:1788832032.491055:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832032.491099:0:7933:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c18f3bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832032.491137:0:7937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe3aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:7937:1875726218312192:0@lo:502: 00000020:01000000:0.0:1788832032.491175:0:7937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832032.491182:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832032.491185:0:7937:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788832032.491191:0:7937:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000100:00100000:3.0:1788832032.493288:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218311424 00000100:00100000:3.0:1788832032.493302:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218311424 00000100:00100000:3.0:1788832032.493367:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788832032.493377:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7933:x1875726218311424:12345-0@lo:1000: 00000100:00100000:3.0:1788832032.493507:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7933:x1875726218311424:12345-0@lo:1000: Request processed in 132us (2458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832032.493515:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788832032.494350:0:7933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe38a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1875726218311424:0@lo:1000: 00000040:01000000:0.0:1788832032.494392:0:7933:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788832032.494436:0:7933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe38a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1875726218312448:0@lo:1000: 00000100:00100000:0.0:1788832032.494610:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832032.494657:0:7933:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c18f3bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832032.494673:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218312448 00000100:00100000:0.0:1788832032.494678:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218312448 00000100:00100000:0.0:1788832032.494707:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788832032.494715:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7933:x1875726218312448:12345-0@lo:1000: 00000100:00100000:0.0:1788832032.494824:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7933:x1875726218312448:12345-0@lo:1000: Request processed in 109us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832032.494832:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788832032.494859:0:7933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe38a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1875726218312448:0@lo:1000: 00000100:00100000:0.0:1788832032.494908:0:7933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe38a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1875726218312576:0@lo:700: 00000100:00100000:0.0:1788832032.494933:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832032.494950:0:7933:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c18f3b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832032.494963:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218312576 00000100:00100000:0.0:1788832032.494967:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218312576 00000100:00100000:0.0:1788832032.494991:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788832032.494998:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7933:x1875726218312576:12345-0@lo:700: 00000100:00100000:0.0:1788832032.495052:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7933:x1875726218312576:12345-0@lo:700: Request processed in 54us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832032.495060:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788832032.495087:0:7933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe38a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1875726218312576:0@lo:700: 00000100:00100000:0.0:1788832032.495173:0:7933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe38a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1875726218312704:0@lo:1000: 00000100:00100000:0.0:1788832032.495198:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832032.495211:0:7933:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c18f3b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788832032.495284:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218312704 00000100:00100000:0.0:1788832032.495288:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218312704 00000100:00100000:0.0:1788832032.495306:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788832032.495313:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7933:x1875726218312704:12345-0@lo:1000: 00000100:00100000:0.0:1788832032.495364:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7933:x1875726218312704:12345-0@lo:1000: Request processed in 51us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832032.495370:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788832032.495396:0:7933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe38a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1875726218312704:0@lo:1000: 00000004:00080000:0.0:1788832032.495432:0:7933:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9d2c18f3b3c0 with version 0 00000020:00100000:0.0:1788832032.495446:0:7933:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788832032.495453:0:7933:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9d2c1fe38a80 x1875726218312960/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788832032.495466:0:7933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe38a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1875726218312960:0@lo:1000: 00000100:00100000:0.0:1788832032.497610:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832032.497659:0:7933:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c348a1900 going to sleep for 11 seconds 00000100:00100000:0.0:1788832032.497681:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218312960 00000100:00100000:0.0:1788832032.497688:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218312960 00000100:00100000:0.0:1788832032.497729:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788832032.497739:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7933:x1875726218312960:12345-0@lo:1000: 00000020:01000000:2.0:1788832032.502748:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788832032.502785:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788832032.502800:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2800/0x998c12b283536ce5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536cec expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.502812:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2800/0x998c12b283536ce5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536cec expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832032.502822:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788832032.502824:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d2c18e319b8 from 1 10000000:01000000:2.0:1788832032.502827:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788832032.502863:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536cf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.502871:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536cf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832032.502880:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536cf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832032.502916:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218313088:0@lo:101: 00000100:00100000:2.0:1788832032.502978:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832032.503015:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0305c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788832032.503450:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218313088 00000100:00100000:0.0:1788832032.503458:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218313088 00000100:00100000:0.0:1788832032.503571:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788832032.503581:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218313088:12345-0@lo:101: 00010000:00010000:0.0:1788832032.503596:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832032.503609:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c00030600/0x998c12b283536cfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536cf3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832032.503655:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c00030600/0x998c12b283536cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536cf3 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832032.503665:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c00030600/0x998c12b283536cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536cf3 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832032.503674:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00030600, rc 0) 00000100:00100000:0.0:1788832032.503720:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+18:6522:x1875726218313088:12345-0@lo:101: Request processed in 141us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832032.503726:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788832032.503829:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe26300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218313088:0@lo:101: 00010000:00010000:0.0:1788832032.503843:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536cf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536cfa expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832032.503853:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536cf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536cfa expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832032.503933:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe3ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218313216:0@lo:501: 00000100:00100000:0.0:1788832032.503963:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832032.503979:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c18f3b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788832032.504004:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218313216 00000100:00100000:0.0:1788832032.504008:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218313216 00000100:00100000:0.0:1788832032.504033:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788832032.504039:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+18:6522:x1875726218313216:12345-0@lo:501: 00000100:00100000:0.0:1788832032.504117:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+18:6522:x1875726218313216:12345-0@lo:501: Request processed in 77us (153us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788832032.504124:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788832032.504150:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe3ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218313216:0@lo:501: 10000000:01000000:0.0:1788832032.504173:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788832032.504179:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536cf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536cfa expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832032.504187:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536cfa expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788832032.506207:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1788832032.506221:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788832032.512172:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7933:x1875726218312960:12345-0@lo:1000: Request processed in 14424us (14555us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788832032.512196:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1788832032.514460:0:7933:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788832032.514469:0:7933:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788832032.514501:0:7933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe38a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1875726218312960:0@lo:1000: 00000100:00100000:0.0:1788832032.514604:0:7933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe38a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1875726218313344:0@lo:1000: 00000100:00100000:0.0:1788832032.514797:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832032.514836:0:7933:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c18f3bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832032.514895:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218313344 00000100:00100000:3.0:1788832032.514903:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218313344 00000100:00100000:3.0:1788832032.514957:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788832032.514967:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7933:x1875726218313344:12345-0@lo:1000: 00000100:00100000:3.0:1788832032.515046:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7933:x1875726218313344:12345-0@lo:1000: Request processed in 80us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832032.515054:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788832032.515412:0:7933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe38a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7933:1875726218313344:0@lo:1000: 00000040:00080000:0.0:1788832032.515434:0:7933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788832032.515470:0:7933:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9d2c18f3b3c0 with version 1 00000040:00080000:0.0:1788832032.521419:0:7933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788832032.522736:0:7933:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788832032.522744:0:7933:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:3.0:1788832032.522972:0:7931:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9d2c0305c240 version 1 rpc_version 1 00000020:00100000:3.0:1788832032.523015:0:7931:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788832032.523036:0:7931:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9d2c182a8380 x1875726218313600/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788832032.523059:0:7931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182a8380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7931:1875726218313600:0@lo:1000: 00000100:00100000:3.0:1788832032.523148:0:7931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832032.523193:0:7931:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c077e0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788832032.523267:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218313600 00000100:00100000:0.0:1788832032.523274:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218313600 00000100:00100000:0.0:1788832032.523330:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788832032.523340:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7931:x1875726218313600:12345-0@lo:1000: 00000001:00080000:3.0:1788832032.530540:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1788832032.530808:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7931:x1875726218313600:12345-0@lo:1000: Request processed in 7466us (7657us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788832032.530820:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:3.0:1788832032.530936:0:7931:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1788832032.530942:0:7931:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788832032.530957:0:7931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182a8380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7931:1875726218313600:0@lo:1000: 00000100:00100000:3.0:1788832032.983411:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218313728:0@lo:41: 00000100:00100000:3.0:1788832032.983513:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832032.983813:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218313728 00000100:00100000:1.0:1788832032.983821:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218313728 00000100:00100000:1.0:1788832032.983875:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788832032.983894:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218313728:12345-0@lo:41: 00000004:00000024:1.0:1788832032.983930:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788832032.990556:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218313728:12345-0@lo:41: Request processed in 6663us (7034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832032.990572:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788832032.995044:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218313728:0@lo:41: 00010000:00010000:1.0:1788832033.238791:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832034.262762:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832035.286867:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832036.310776:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832037.341281:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832037.592787:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218313856:0@lo:41: 00000100:00100000:3.0:1788832037.592873:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832037.592962:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218313856 00000100:00100000:3.0:1788832037.592970:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218313856 00000100:00100000:3.0:1788832037.593019:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788832037.593030:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218313856:12345-0@lo:41: 00000004:00000024:3.0:1788832037.593065:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788832037.593128:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218313856:12345-0@lo:41: Request processed in 100us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832037.593134:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788832037.593343:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218313856:0@lo:41: 00000100:00100000:0.0:1788832037.593493:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875726218314112:0@lo:400: 00000100:00100000:0.0:1788832037.593541:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832037.593562:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788832037.593567:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218313984:0@lo:400: 00000100:00100000:0.0:1788832037.593590:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832037.593644:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218314112 00000100:00100000:0.0:1788832037.593648:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218314112 00000100:00100000:0.0:1788832037.593689:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788832037.593695:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875726218314112:12345-0@lo:400: 00000100:00100000:0.0:1788832037.593729:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875726218314112:12345-0@lo:400: Request processed in 34us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832037.593735:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788832037.593752:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218313984 00000100:00100000:0.0:1788832037.593754:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218313984 00000100:00100000:0.0:1788832037.593772:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788832037.593777:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+18:3652:x1875726218313984:12345-0@lo:400: 00000100:00100000:0.0:1788832037.593802:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+18:3652:x1875726218313984:12345-0@lo:400: Request processed in 24us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832037.593814:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788832037.593829:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218314240:0@lo:400: 00000100:00100000:3.0:1788832037.593873:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832037.593899:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788832037.593906:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218314368:0@lo:400: 00000100:00100000:3.0:1788832037.593944:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832037.593974:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218314240 00000100:00100000:3.0:1788832037.593978:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218314240 00000100:00100000:3.0:1788832037.594004:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788832037.594010:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218314240:12345-0@lo:400: 00000100:00100000:3.0:1788832037.594049:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218314240:12345-0@lo:400: Request processed in 39us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832037.594056:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788832037.594077:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218314368 00000100:00100000:3.0:1788832037.594082:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218314368 00000100:00100000:3.0:1788832037.594118:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788832037.594125:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218314368:12345-0@lo:400: 00000100:00100000:3.0:1788832037.594158:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218314368:12345-0@lo:400: Request processed in 34us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832037.594165:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788832037.594207:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d2c1fe39180 x1875726218314368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832037.594219:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218314368:0@lo:400: 00000100:00100000:3.0:1788832037.594229:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218314240:0@lo:400: 00000100:00100000:0.0:1788832037.594980:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218313984:0@lo:400: 00010000:00080000:0.0:1788832037.594995:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d2c1fe39880 x1875726218314112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832037.595006:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875726218314112:0@lo:400: 00000100:00100000:1.0:1788832038.103172:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788832038.103198:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218314496:0@lo:41: 00000100:00100000:1.0:1788832038.103272:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832038.103456:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218314496 00000100:00100000:3.0:1788832038.103465:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218314496 00000100:00100000:3.0:1788832038.103520:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788832038.103530:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218314496:12345-0@lo:41: 00000004:00000024:3.0:1788832038.103561:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788832038.103616:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218314496:12345-0@lo:41: Request processed in 87us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832038.103664:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788832038.103993:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218314496:0@lo:41: 00010000:00010000:3.0:1788832038.363424:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832039.390287:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832040.408677:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832041.430800:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788832041.515767:0:8433:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788832041.515772:0:8433:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788832041.515773:0:8433:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788832041.515918:0:8433:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d2c3e677800 00000020:01000004:1.0:1788832041.515933:0:8433:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788832041.515945:0:8433:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788832041.515960:0:8433:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9d2c18eccd28) 00000020:00000080:1.0:1788832041.515981:0:8433:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788832041.562144:0:8433:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788832041.562208:0:8433:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:1.0:1788832041.589993:0:8433:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788832041.590201:0:8433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788832041.590213:0:8433:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788832041.590225:0:8433:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x998c12b283536d08 00000020:01000004:1.0:1788832041.590232:0:8433:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788832041.590253:0:8433:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.126@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788832041.590256:0:8433:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788832041.590261:0:8433:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788832041.590266:0:8433:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788832041.590276:0:8433:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9d2c18ec8000) 00000020:00000080:1.0:1788832041.590288:0:8433:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:1.0:1788832041.597582:0:8433:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788832041.597802:0:8433:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788832041.597809:0:8433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788832041.603166:0:8433:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788832041.603182:0:8433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788832041.605841:0:8433:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788832041.605853:0:8433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788832041.618997:0:8433:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788832041.619181:0:8433:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788832041.619188:0:8433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788832041.621031:0:8433:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788832041.621044:0:8433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788832041.643558:0:8433:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788832041.643900:0:8433:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788832041.643908:0:8433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788832041.647577:0:8433:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788832041.647592:0:8433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788832041.648396:0:8433:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788832041.648404:0:8433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788832041.651503:0:8433:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788832041.651928:0:8433:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788832041.651937:0:8433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788832041.652582:0:8433:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788832041.652589:0:8433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788832041.696614:0:8433:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788832041.696935:0:8433:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788832041.696942:0:8433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788832041.697917:0:8433:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788832041.697925:0:8433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788832041.698310:0:8433:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788832041.698340:0:8433:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788832041.698347:0:8433:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788832041.719034:0:8433:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788832041.719072:0:8433:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.126@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788832041.719076:0:8433:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788832041.719079:0:8433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788832041.719080:0:8433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788832041.719081:0:8433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788832041.719083:0:8433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788832041.719084:0:8433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788832041.719085:0:8433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788832041.719086:0:8433:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788832041.719088:0:8433:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788832041.719089:0:8433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788832041.719093:0:8433:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788832041.719097:0:8433:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788832041.719099:0:8433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788832041.719100:0:8433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788832041.719101:0:8433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788832041.719102:0:8433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788832041.719103:0:8433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788832041.719104:0:8433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788832041.719105:0:8433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788832041.719106:0:8433:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788832041.719107:0:8433:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788832041.719108:0:8433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788832041.719109:0:8433:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788832041.719137:0:8433:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788832041.719153:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218314624:0@lo:253: 00000100:00100000:2.0:1788832041.719225:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832041.719309:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36c2de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832041.719349:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218314624 00000100:00100000:0.0:1788832041.719357:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218314624 00000100:00100000:0.0:1788832041.719437:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788832041.719448:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+18:8433:x1875726218314624:12345-0@lo:253: 20000000:01000000:0.0:1788832041.719485:0:6517:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788832041.719489:0:6517:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788832041.719494:0:6517:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788832041.719497:0:6517:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788832041.719733:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788832041.719863:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788832041.719876:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788832041.719892:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788832041.719897:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788832041.719907:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788832041.719919:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788832041.719983:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788832041.720003:0:6517:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.126@tcp 20000000:01000000:0.0:1788832041.720005:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:0.0:1788832041.720016:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788832041.720021:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788832041.720033:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788832041.720038:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:0.0:1788832041.720048:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788832041.720054:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788832041.720064:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788832041.720075:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788832041.720128:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1788832041.720136:0:6517:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.126@tcp 20000000:01000000:0.0:1788832041.720137:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:0.0:1788832041.720159:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1788832041.720164:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788832041.720174:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1788832041.720178:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:0.0:1788832041.720188:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1788832041.720192:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788832041.720202:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1788832041.720214:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1788832041.720611:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1788832041.720910:0:6517:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.126@tcp 20000000:01000000:0.0:1788832041.720912:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:0.0:1788832041.720931:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1788832041.720937:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788832041.720948:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1788832041.720952:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:0.0:1788832041.720962:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1788832041.720967:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788832041.720986:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1788832041.720998:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1788832041.721010:0:6517:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788832041.721013:0:6517:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788832041.721017:0:6517:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788832041.721057:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788832041.721059:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788832041.721400:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788832041.721817:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788832041.721850:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788832041.721865:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788832041.721875:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788832041.721877:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788832041.722146:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1788832041.722167:0:8453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1788832041.722181:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788832041.722336:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1788832041.722356:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1788832041.722389:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1788832041.722402:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788832041.722404:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788832041.722752:0:8454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1788832041.722775:0:8454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1788832041.722791:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1788832041.722946:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1788832041.722964:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1788832041.722977:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1788832041.722985:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788832041.722986:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788832041.723272:0:8455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1788832041.723291:0:8455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1788832041.723307:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788832041.723454:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788832041.723471:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788832041.723484:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:0.0:1788832041.723499:0:6517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788832041.723518:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d2c00030c00/0x998c12b283536d16 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.723536:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c421d3000/0x998c12b283536be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536bdb expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.723544:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c00031e00/0x998c12b283536c59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536c52 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.723559:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c390f2a00/0x998c12b283536ca6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536c9f expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.723566:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c390f2e00/0x998c12b283536cc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536cbb expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.723573:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c00030600/0x998c12b283536cfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536cf3 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.723580:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d2c00030c00/0x998c12b283536d16 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.723614:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c00030600/0x998c12b283536cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536cf3 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.723744:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c00030600/0x998c12b283536cfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536cf3 expref: 18 pid: 6519 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832041.723758:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e776d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218314752:0@lo:104: 00000100:00100000:0.0:1788832041.723833:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832041.723931:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c390f2e00/0x998c12b283536cc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536cbb expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.723939:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c390f2e00/0x998c12b283536cc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536cbb expref: 18 pid: 6518 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832041.723947:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e774380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218314880:0@lo:104: 00000100:00100000:0.0:1788832041.723969:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832041.724046:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c390f2a00/0x998c12b283536ca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536c9f expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.724062:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c390f2a00/0x998c12b283536ca6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536c9f expref: 18 pid: 6518 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832041.724070:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e775500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218315008:0@lo:104: 00000100:00100000:0.0:1788832041.724107:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832041.724167:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218314752 00000100:00100000:1.0:1788832041.724174:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218314752 00000100:00100000:1.0:1788832041.724208:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218314880 00000100:00100000:1.0:1788832041.724211:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218314880 00000100:00100000:1.0:1788832041.724225:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788832041.724234:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e776680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+4:6517:x1875726218314752:12345-0@lo:104: 00010000:00010000:1.0:1788832041.724246:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536cfa expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.724307:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788832041.724314:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e776680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+4:6517:x1875726218314752:12345-0@lo:104: Request processed in 81us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832041.724321:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788832041.724338:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788832041.724352:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e774000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+3:6517:x1875726218314880:12345-0@lo:104: 00010000:00010000:1.0:1788832041.724361:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd800/0x998c12b283536cbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536cc2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.724397:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788832041.724403:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e774000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+3:6517:x1875726218314880:12345-0@lo:104: Request processed in 52us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832041.724409:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788832041.724426:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788832041.724432:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536cfa expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.724438:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc600 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:1.0:1788832041.724442:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536cfa expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.724450:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536cfa expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788832041.724456:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536cfa expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832041.724462:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788832041.724491:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536cf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536cfa expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.724498:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788832041.724517:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536cf3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536cfa expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.724534:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536cf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536cfa expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.724548:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832041.724552:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd800/0x998c12b283536cbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536cc2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.724557:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dd800 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:1.0:1788832041.724560:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd800/0x998c12b283536cbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536cc2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.724567:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd800/0x998c12b283536cbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536cc2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788832041.724574:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd800/0x998c12b283536cbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536cc2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832041.724579:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788832041.724593:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd800/0x998c12b283536cbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536cc2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.724599:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788832041.724612:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd800/0x998c12b283536cbb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536cc2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.724652:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd800/0x998c12b283536cbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536cc2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.724660:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832041.724668:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832041.724670:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832041.724683:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218315136:0@lo:103: 00000100:00100000:1.0:1788832041.724712:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832041.724742:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832041.724751:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218315264:0@lo:103: 00000100:00100000:1.0:1788832041.724773:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832041.724797:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218315136 00000100:00100000:1.0:1788832041.724800:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218315136 00010000:00010000:1.0:1788832041.724818:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c00030600/0x998c12b283536cfa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536cf3 expref: 19 pid: 6519 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832041.724847:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218315264 00000100:00100000:1.0:1788832041.724851:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218315264 00010000:00010000:1.0:1788832041.724862:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c390f2e00/0x998c12b283536cc2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536cbb expref: 20 pid: 6518 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832041.724879:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788832041.724885:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+20:3652:x1875726218315136:12345-0@lo:103: 00010000:00010000:1.0:1788832041.724895:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832041.724900:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c00030600/0x998c12b283536cfa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536cf3 expref: 20 pid: 6519 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.724910:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c00030600/0x998c12b283536cfa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536cf3 expref: 20 pid: 6519 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.724925:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832041.724952:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+20:3652:x1875726218315136:12345-0@lo:103: Request processed in 68us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832041.724958:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788832041.724978:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788832041.724984:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+19:3654:x1875726218315264:12345-0@lo:103: 00010000:00010000:1.0:1788832041.724992:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832041.724996:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c390f2e00/0x998c12b283536cc2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536cbb expref: 19 pid: 6518 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.725005:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c390f2e00/0x998c12b283536cc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536cbb expref: 19 pid: 6518 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.725014:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832041.725042:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+19:3654:x1875726218315264:12345-0@lo:103: Request processed in 58us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832041.725047:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788832041.725086:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218315264:0@lo:103: 00000100:00100000:1.0:1788832041.725109:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218315136:0@lo:103: 00010000:00010000:2.0:1788832041.725197:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832041.725309:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c00031e00/0x998c12b283536c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536c52 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.725319:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c00031e00/0x998c12b283536c59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536c52 expref: 18 pid: 6518 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832041.725328:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e777100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218315392:0@lo:104: 00000100:00100000:0.0:1788832041.725351:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832041.725523:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c421d3000/0x998c12b283536be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536bdb expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.725532:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c421d3000/0x998c12b283536be2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536bdb expref: 18 pid: 6519 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832041.725540:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e776a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218315520:0@lo:104: 00000100:00100000:0.0:1788832041.725563:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832041.725863:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218315008 00000100:00100000:3.0:1788832041.725869:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218315008 00000100:00100000:3.0:1788832041.725898:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218315392 00000100:00100000:3.0:1788832041.725901:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218315392 00000100:00100000:3.0:1788832041.725913:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788832041.725920:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e777b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+4:6517:x1875726218315008:12345-0@lo:104: 00010000:00010000:3.0:1788832041.725930:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd400/0x998c12b283536c9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536ca6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.725973:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788832041.725979:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e777b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+4:6517:x1875726218315008:12345-0@lo:104: Request processed in 60us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832041.725986:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788832041.726003:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788832041.726009:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e775c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+3:6517:x1875726218315392:12345-0@lo:104: 00010000:00010000:3.0:1788832041.726016:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536c52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536c59 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.726051:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788832041.726056:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e775c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+3:6517:x1875726218315392:12345-0@lo:104: Request processed in 48us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832041.726062:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788832041.726081:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788832041.726087:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd400/0x998c12b283536c9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536ca6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.726108:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dd400 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832041.726111:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd400/0x998c12b283536c9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536ca6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.726118:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd400/0x998c12b283536c9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536ca6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832041.726125:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd400/0x998c12b283536c9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536ca6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832041.726130:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788832041.726155:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd400/0x998c12b283536c9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536ca6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.726161:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832041.726174:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd400/0x998c12b283536c9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536ca6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.726181:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd400/0x998c12b283536c9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536ca6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.726191:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832041.726194:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536c52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536c59 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.726200:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031600 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832041.726202:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536c52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536c59 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.726220:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536c52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536c59 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832041.726226:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536c52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536c59 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832041.726231:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788832041.726244:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536c52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536c59 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.726250:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832041.726262:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536c52 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536c59 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.726268:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536c52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536c59 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.726277:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832041.726279:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832041.726280:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832041.726286:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788832041.726297:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218315648:0@lo:103: 00000100:00100000:3.0:1788832041.726325:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832041.726356:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218315776:0@lo:103: 00000100:00100000:3.0:1788832041.726377:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832041.726403:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218315648 00000100:00100000:3.0:1788832041.726407:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218315648 00010000:00010000:3.0:1788832041.726422:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c390f2a00/0x998c12b283536ca6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536c9f expref: 19 pid: 6518 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832041.726455:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218315776 00000100:00100000:3.0:1788832041.726458:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218315776 00010000:00010000:3.0:1788832041.726470:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c00031e00/0x998c12b283536c59 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536c52 expref: 20 pid: 6518 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832041.726487:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788832041.726493:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+20:3653:x1875726218315648:12345-0@lo:103: 00010000:00010000:3.0:1788832041.726502:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832041.726506:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c390f2a00/0x998c12b283536ca6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536c9f expref: 20 pid: 6518 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.726515:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c390f2a00/0x998c12b283536ca6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536c9f expref: 20 pid: 6518 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.726529:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832041.726557:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+20:3653:x1875726218315648:12345-0@lo:103: Request processed in 64us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832041.726563:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788832041.726576:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788832041.726582:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+19:3651:x1875726218315776:12345-0@lo:103: 00010000:00010000:3.0:1788832041.726589:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832041.726594:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c00031e00/0x998c12b283536c59 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536c52 expref: 19 pid: 6518 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.726603:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c00031e00/0x998c12b283536c59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536c52 expref: 19 pid: 6518 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.726612:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832041.726673:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+19:3651:x1875726218315776:12345-0@lo:103: Request processed in 91us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832041.726679:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788832041.726720:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218315776:0@lo:103: 00000100:00100000:3.0:1788832041.726743:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218315648:0@lo:103: 00010000:00010000:2.0:1788832041.726815:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832041.726968:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0927f780 going to sleep for 11 seconds 00010000:00010000:0.0:1788832041.726984:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c00030600/0x998c12b283536cfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536cf3 expref: 18 pid: 6519 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832041.726995:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e776d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218314752:0@lo:104: 00010000:00010000:0.0:1788832041.727005:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c390f2e00/0x998c12b283536cc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536cbb expref: 17 pid: 6518 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832041.727025:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e774380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218314880:0@lo:104: 00010000:00010000:0.0:1788832041.727037:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c390f2a00/0x998c12b283536ca6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536c9f expref: 16 pid: 6518 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832041.727044:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e775500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218315008:0@lo:104: 00010000:00010000:0.0:1788832041.727053:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c00031e00/0x998c12b283536c59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536c52 expref: 15 pid: 6518 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832041.727061:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e777100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218315392:0@lo:104: 00000100:00100000:3.0:1788832041.727093:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218315520 00000100:00100000:3.0:1788832041.727098:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218315520 00000100:00100000:3.0:1788832041.727159:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788832041.727167:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e777800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+3:6517:x1875726218315520:12345-0@lo:104: 00010000:00010000:3.0:1788832041.727177:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c4204ac00/0x998c12b283536bdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536be2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.727262:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788832041.727268:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e777800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+3:6517:x1875726218315520:12345-0@lo:104: Request processed in 103us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832041.727273:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788832041.727319:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e776a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218315520:0@lo:104: 00010000:00010000:0.0:1788832041.727341:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d2c00030c00/0x998c12b283536d16 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832041.727375:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832041.727381:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c4204ac00/0x998c12b283536bdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536be2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832041.727387:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c4204ac00 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832041.727396:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c4204ac00/0x998c12b283536bdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536be2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832041.727403:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c4204ac00/0x998c12b283536bdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536be2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832041.727409:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c4204ac00/0x998c12b283536bdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536be2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832041.727415:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832041.727446:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c4204ac00/0x998c12b283536bdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536be2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832041.727453:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832041.727465:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c4204ac00/0x998c12b283536bdb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536be2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832041.727471:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c4204ac00/0x998c12b283536bdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536be2 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832041.727485:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832041.727487:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832041.727489:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832041.727671:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218315904:0@lo:103: 00000100:00100000:0.0:1788832041.727703:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832041.727820:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218315904 00000100:00100000:1.0:1788832041.727833:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218315904 00010000:00010000:1.0:1788832041.727851:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c421d3000/0x998c12b283536be2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536bdb expref: 15 pid: 6519 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832041.727880:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788832041.727887:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18e24050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+15:3652:x1875726218315904:12345-0@lo:103: 00010000:00010000:1.0:1788832041.727895:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832041.727900:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c421d3000/0x998c12b283536be2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536bdb expref: 15 pid: 6519 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.727911:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c421d3000/0x998c12b283536be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536bdb expref: 15 pid: 6519 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.727933:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c421d3000/0x998c12b283536be2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536bdb expref: 15 pid: 6519 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.727945:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d2c00030c00/0x998c12b283536d16 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.727952:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c00030c00/0x998c12b283536d16 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.727964:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c00030c00/0x998c12b283536d16 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.727970:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c00030c00/0x998c12b283536d16 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.727977:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d2c00030c00/0x998c12b283536d16 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.727983:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d2c00030c00/0x998c12b283536d16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.727987:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030c00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:1.0:1788832041.727991:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d2c00030c00/0x998c12b283536d16 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.727997:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d2c00030c00/0x998c12b283536d16 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.728009:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d2c00030c00/0x998c12b283536d16 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.728026:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832041.728058:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18e24050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+14:3652:x1875726218315904:12345-0@lo:103: Request processed in 172us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832041.728065:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788832041.728114:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218315904:0@lo:103: 00010000:00010000:1.0:1788832041.728132:0:6517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d2c00030c00/0x998c12b283536d16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.728140:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d2c00030c00/0x998c12b283536d16 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.728146:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c00030c00/0x998c12b283536d16 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788832041.728158:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788832041.729970:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+13:8433:x1875726218314624:12345-0@lo:253: Request processed in 10516us (10736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832041.729984:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788832041.730099:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218314624:0@lo:253: 10000000:01000000:1.0:1788832041.730113:0:8433:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788832041.730117:0:8433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788832041.730118:0:8433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788832041.730119:0:8433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832041.730120:0:8433:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788832041.730122:0:8433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832041.730123:0:8433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832041.730124:0:8433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788832041.730126:0:8433:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788832041.730127:0:8433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832041.730129:0:8433:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788832041.730150:0:8433:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d2c3e677800 from lustre-OST0000 10000000:01000000:1.0:1788832041.730197:0:8433:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788832041.730201:0:8433:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788832041.730208:0:8433:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d2c18e319b8 local copy 10000000:01000000:1.0:1788832041.730218:0:8433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788832041.730252:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536d1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.730263:0:8433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536d1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.730272:0:8433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536d1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832041.730291:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218316032:0@lo:101: 00000100:00100000:1.0:1788832041.730328:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832041.730367:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0322e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788832041.730416:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218316032 00000100:00100000:0.0:1788832041.730433:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218316032 00000100:00100000:0.0:1788832041.730475:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788832041.730484:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+13:8433:x1875726218316032:12345-0@lo:101: 00010000:00010000:0.0:1788832041.730497:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832041.730513:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c00031c00/0x998c12b283536d24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536d1d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.730550:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c00031c00/0x998c12b283536d24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536d1d expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.730562:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c00031c00/0x998c12b283536d24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536d1d expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.730571:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031c00, rc 0) 00000100:00100000:0.0:1788832041.730614:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+14:8433:x1875726218316032:12345-0@lo:101: Request processed in 131us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832041.730649:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788832041.730790:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218316032:0@lo:101: 00010000:00010000:1.0:1788832041.730802:0:8433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536d1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x998c12b283536d24 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.730811:0:8433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536d1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x998c12b283536d24 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832041.730906:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218316160:0@lo:501: 00000100:00100000:1.0:1788832041.730932:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832041.730953:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0322e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788832041.730994:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218316160 00000100:00100000:0.0:1788832041.730999:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218316160 00000100:00100000:0.0:1788832041.731029:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788832041.731036:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+14:8433:x1875726218316160:12345-0@lo:501: 00000100:00100000:0.0:1788832041.731088:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+14:8433:x1875726218316160:12345-0@lo:501: Request processed in 52us (155us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788832041.731095:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788832041.731153:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218316160:0@lo:501: 10000000:01000000:1.0:1788832041.731165:0:8433:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788832041.731196:0:8433:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788832041.731202:0:8433:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536d1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x998c12b283536d24 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.731220:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536d1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x998c12b283536d24 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.731227:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536d1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x998c12b283536d24 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.731253:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788832041.731278:0:8433:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d2c3e677800 10000000:01000000:1.0:1788832041.731283:0:8433:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788832041.731288:0:8433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788832041.731291:0:8433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788832041.731295:0:8433:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788832041.731298:0:8433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788832041.731312:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536d2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.731319:0:8433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536d2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.731327:0:8433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536d2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832041.731338:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218316288:0@lo:101: 00000100:00100000:1.0:1788832041.731363:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832041.731378:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c028dde40 going to sleep for 11 seconds 00000100:00100000:1.0:1788832041.731392:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218316288 00000100:00100000:1.0:1788832041.731396:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218316288 00000100:00100000:1.0:1788832041.731421:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788832041.731438:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+14:8433:x1875726218316288:12345-0@lo:101: 00010000:00010000:1.0:1788832041.731451:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832041.731459:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c390f3800/0x998c12b283536d32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536d2b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.731472:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c390f3800/0x998c12b283536d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536d2b expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.731688:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832041.731696:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536d1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x998c12b283536d24 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.731703:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c390f2400 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:0.0:1788832041.731708:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536d1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x998c12b283536d24 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.731716:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536d1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x998c12b283536d24 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832041.731735:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536d1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x998c12b283536d24 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832041.731740:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788832041.731761:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536d1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x998c12b283536d24 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.731767:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832041.731790:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536d1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x998c12b283536d24 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.731797:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536d1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x998c12b283536d24 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.731809:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832041.731811:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832041.731812:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832041.732164:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c390f3800/0x998c12b283536d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536d2b expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.732174:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c390f3800, rc 0) 00000100:00100000:1.0:1788832041.732229:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+15:8433:x1875726218316288:12345-0@lo:101: Request processed in 791us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832041.732236:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788832041.732343:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218316288:0@lo:101: 00010000:00010000:0.0:1788832041.732356:0:8433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536d2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536d32 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.732365:0:8433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536d2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536d32 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832041.732464:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e777100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218316544:0@lo:501: 00000100:00100000:0.0:1788832041.732494:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832041.732516:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0927f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788832041.732611:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218316544 00000100:00100000:1.0:1788832041.732616:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218316544 00000100:00100000:1.0:1788832041.732667:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788832041.732674:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+15:8433:x1875726218316544:12345-0@lo:501: 00000100:00100000:1.0:1788832041.732767:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+15:8433:x1875726218316544:12345-0@lo:501: Request processed in 93us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832041.732773:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788832041.732801:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e777100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218316544:0@lo:501: 00000100:00100000:1.0:1788832041.732838:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218316672:0@lo:503: 00000100:00100000:1.0:1788832041.732877:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832041.732890:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c028dde40 going to sleep for 11 seconds 00000100:00100000:1.0:1788832041.732903:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218316672 00000100:00100000:1.0:1788832041.732906:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218316672 00000100:00100000:1.0:1788832041.732923:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788832041.732935:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+15:8433:x1875726218316672:12345-0@lo:503: 00000100:00100000:1.0:1788832041.733007:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+15:8433:x1875726218316672:12345-0@lo:503: Request processed in 72us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832041.733014:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788832041.733053:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218316672:0@lo:503: 00000040:00080000:1.0:1788832041.733282:0:8433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788832041.733346:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218316800:0@lo:502: 00000100:00100000:1.0:1788832041.733382:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832041.733396:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0a0e9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788832041.733409:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218316800 00000100:00100000:1.0:1788832041.733412:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218316800 00000100:00100000:1.0:1788832041.733441:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788832041.733448:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+15:8433:x1875726218316800:12345-0@lo:502: 00000100:00100000:1.0:1788832041.733519:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+15:8433:x1875726218316800:12345-0@lo:502: Request processed in 71us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832041.733525:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788832041.733561:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218316800:0@lo:502: 00000040:00080000:1.0:1788832041.733751:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788832041.733775:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788832041.733789:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788832041.733801:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788832041.733836:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788832041.733854:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788832041.733872:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218316928:0@lo:502: 00000100:00100000:1.0:1788832041.733903:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832041.733917:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c028dde40 going to sleep for 11 seconds 00000100:00100000:1.0:1788832041.733929:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218316928 00000100:00100000:1.0:1788832041.733938:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218316928 00000100:00100000:1.0:1788832041.733958:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788832041.733962:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+15:8433:x1875726218316928:12345-0@lo:502: 00000100:00100000:1.0:1788832041.734707:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+15:8433:x1875726218316928:12345-0@lo:502: Request processed in 740us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832041.734716:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788832041.734775:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218316928:0@lo:502: 00000040:00080000:1.0:1788832041.734834:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788832041.734844:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000100:00100000:3.0:1788832041.735111:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218316416:0@lo:103: 00000100:00100000:3.0:1788832041.735144:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832041.735615:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218316416 00000100:00100000:1.0:1788832041.735648:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218316416 00000100:00100000:1.0:1788832041.735689:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788832041.735698:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e55f0905-9d39-4464-9830-326b420fb582+15:3653:x1875726218316416:12345-0@lo:103: 00010000:00010000:1.0:1788832041.735709:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832041.735733:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c00031c00/0x998c12b283536d24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x998c12b283536d1d expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.735750:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832041.735787:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e55f0905-9d39-4464-9830-326b420fb582+14:3653:x1875726218316416:12345-0@lo:103: Request processed in 90us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832041.735793:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788832041.735819:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e776a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218316416:0@lo:103: 00000020:01000000:0.0:1788832041.735982:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788832041.735995:0:8456:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788832041.736001:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832041.736003:0:8456:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788832041.736008:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788832041.736028:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9d2b0600cd28) 00000020:00000080:0.0:1788832041.736050:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788832041.736055:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788832041.736127:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d2c3e677800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788832041.736135:0:8456:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788832041.736142:0:8456:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x998c12b283536d40 00010000:00010000:0.0:1788832041.740289:0:8456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1788832041.740868:0:8456:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788832041.744024:0:8456:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788832041.744381:0:8456:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788832041.749010:0:8456:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1788832041.749184:0:8456:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1788832041.763558:0:8456:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788832041.765204:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788832041.765217:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832041.765223:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832041.765225:0:8456:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788832041.765228:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832041.765232:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832041.765233:0:8456:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788832041.765236:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788832041.765238:0:8456:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788832041.765260:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832041.765262:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832041.765264:0:8456:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788832041.765267:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788832041.765398:0:8433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788832041.765436:0:8433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788832041.765456:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536d2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536d32 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.765467:0:8433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536d2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536d32 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832041.765481:0:8433:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2c3e677800 from 1 10000000:01000000:1.0:1788832041.765483:0:8433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788832041.765516:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b283536d47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.765524:0:8433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b283536d47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.765534:0:8433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b283536d47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832041.765558:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218317056:0@lo:101: 00000100:00100000:1.0:1788832041.765658:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832041.765691:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c028dde40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832041.765813:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218317056 00000100:00100000:3.0:1788832041.765821:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218317056 00000100:00100000:3.0:1788832041.765880:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788832041.765891:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+14:8433:x1875726218317056:12345-0@lo:101: 00010000:00010000:3.0:1788832041.765905:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832041.765919:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c421d3600/0x998c12b283536d4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536d47 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.765943:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d3600/0x998c12b283536d4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536d47 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.765962:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c421d3600/0x998c12b283536d4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536d47 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.765970:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d3600, rc 0) 00000100:00100000:3.0:1788832041.766011:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+15:8433:x1875726218317056:12345-0@lo:101: Request processed in 122us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832041.766017:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788832041.766061:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218317056:0@lo:101: 00010000:00010000:3.0:1788832041.766074:0:8433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b283536d47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536d4e expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.766083:0:8433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b283536d47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536d4e expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832041.766179:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218317184:0@lo:501: 00000100:00100000:3.0:1788832041.766205:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832041.766220:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36d19f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832041.766235:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218317184 00000100:00100000:3.0:1788832041.766239:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218317184 00000100:00100000:3.0:1788832041.766259:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788832041.766266:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:8433:x1875726218317184:12345-0@lo:501: 00000100:00100000:3.0:1788832041.766358:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:8433:x1875726218317184:12345-0@lo:501: Request processed in 92us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832041.766365:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788832041.766394:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218317184:0@lo:501: 00000100:00100000:3.0:1788832041.766420:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218317312:0@lo:503: 00000100:00100000:3.0:1788832041.766472:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832041.766486:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36d19f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832041.766498:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218317312 00000100:00100000:3.0:1788832041.766501:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218317312 00000100:00100000:3.0:1788832041.766522:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788832041.766528:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:8433:x1875726218317312:12345-0@lo:503: 00000100:00100000:3.0:1788832041.766601:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:8433:x1875726218317312:12345-0@lo:503: Request processed in 72us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832041.766607:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788832041.766677:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218317312:0@lo:503: 00000040:00080000:3.0:1788832041.766911:0:8433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788832041.766971:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218317440:0@lo:502: 00000100:00100000:3.0:1788832041.767008:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832041.767023:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36d19f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832041.767036:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218317440 00000100:00100000:3.0:1788832041.767039:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218317440 00000100:00100000:3.0:1788832041.767060:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788832041.767066:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:8433:x1875726218317440:12345-0@lo:502: 00000100:00100000:3.0:1788832041.767133:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:8433:x1875726218317440:12345-0@lo:502: Request processed in 67us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832041.767139:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788832041.767175:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218317440:0@lo:502: 00000040:00080000:3.0:1788832041.767354:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788832041.767376:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788832041.767392:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218317568:0@lo:502: 00000100:00100000:3.0:1788832041.767420:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832041.767438:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36d19f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832041.767449:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218317568 00000100:00100000:3.0:1788832041.767452:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218317568 00000100:00100000:3.0:1788832041.767471:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788832041.767476:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:8433:x1875726218317568:12345-0@lo:502: 00000100:00100000:3.0:1788832041.767531:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:8433:x1875726218317568:12345-0@lo:502: Request processed in 53us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832041.767537:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788832041.767573:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218317568:0@lo:502: 00000040:00080000:3.0:1788832041.767646:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788832041.767655:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788832041.769706:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832041.769717:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832041.769720:0:8459:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788832041.769728:0:8459:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d2c3e677800 00000020:00000080:1.0:1788832041.769730:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788832041.769743:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832041.769747:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832041.769748:0:8459:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788832041.769751:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788832041.771507:0:8433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788832041.771549:0:8433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788832041.771579:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b283536d47 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536d4e expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.771599:0:8433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b283536d47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536d4e expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832041.771672:0:8433:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788832041.771675:0:8433:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d2c3e677800 10000000:01000000:0.0:1788832041.771678:0:8433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d2c3e677800 10000000:01000000:0.0:1788832041.771683:0:8433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788832041.771689:0:8433:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d2c3e677800 from 1 10000000:01000000:0.0:1788832041.771692:0:8433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788832041.771732:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b283536d55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.771966:0:8433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b283536d55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.771978:0:8433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b283536d55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832041.772002:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e775500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218317696:0@lo:101: 00000100:00100000:0.0:1788832041.772067:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832041.772113:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0927f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832041.772205:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218317696 00000100:00100000:3.0:1788832041.772212:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218317696 00000100:00100000:3.0:1788832041.772262:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788832041.772271:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:8433:x1875726218317696:12345-0@lo:101: 00010000:00010000:3.0:1788832041.772286:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832041.772298:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c421d2c00/0x998c12b283536d5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536d55 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.772322:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d2c00/0x998c12b283536d5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536d55 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.772333:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c421d2c00/0x998c12b283536d5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536d55 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.772342:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2c00, rc 0) 00000100:00100000:3.0:1788832041.772381:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+16:8433:x1875726218317696:12345-0@lo:101: Request processed in 111us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832041.772388:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788832041.772480:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e775500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218317696:0@lo:101: 00010000:00010000:0.0:1788832041.772494:0:8433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b283536d55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536d5c expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.772503:0:8433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b283536d55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536d5c expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832041.772599:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e775500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218317824:0@lo:501: 00000100:00100000:0.0:1788832041.772649:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832041.772706:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0927f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832041.773020:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218317824 00000100:00100000:2.0:1788832041.773026:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218317824 00000100:00100000:2.0:1788832041.773064:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788832041.773071:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+16:8433:x1875726218317824:12345-0@lo:501: 00000100:00100000:2.0:1788832041.773182:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+16:8433:x1875726218317824:12345-0@lo:501: Request processed in 112us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832041.773189:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788832041.774114:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e775500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218317824:0@lo:501: 00000100:00100000:1.0:1788832041.774179:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218317952:0@lo:503: 00000100:00100000:1.0:1788832041.774234:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832041.774270:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c028dde40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832041.774342:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218317952 00000100:00100000:0.0:1788832041.774347:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218317952 00000100:00100000:0.0:1788832041.774389:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788832041.774397:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+16:8433:x1875726218317952:12345-0@lo:503: 00000100:00100000:0.0:1788832041.774550:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+16:8433:x1875726218317952:12345-0@lo:503: Request processed in 153us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832041.774558:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788832041.774988:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218317952:0@lo:503: 00000040:00080000:3.0:1788832041.775233:0:8433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788832041.775300:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218318080:0@lo:502: 00000100:00100000:3.0:1788832041.775346:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832041.775420:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218318080 00000100:00100000:3.0:1788832041.775421:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36d19840 going to sleep for 11 seconds 00000100:00100000:1.0:1788832041.775469:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218318080 00000100:00100000:1.0:1788832041.775556:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788832041.775563:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+16:8433:x1875726218318080:12345-0@lo:502: 00000100:00100000:2.0:1788832041.775717:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+16:8433:x1875726218318080:12345-0@lo:502: Request processed in 154us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832041.775725:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788832041.775728:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218318080:0@lo:502: 00000040:00080000:3.0:1788832041.776091:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788832041.776119:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788832041.776132:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788832041.776143:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788832041.776153:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788832041.776164:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788832041.776176:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788832041.776191:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788832041.776205:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788832041.776218:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788832041.776231:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788832041.776259:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788832041.776274:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788832041.776284:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788832041.776295:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788832041.776306:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788832041.776319:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788832041.776332:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788832041.776344:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788832041.776355:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788832041.776367:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788832041.776381:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788832041.776392:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788832041.776405:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788832041.776429:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788832041.776443:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788832041.776456:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788832041.776478:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788832041.776493:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788832041.777287:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788832041.777312:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788832041.777325:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788832041.777338:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788832041.777350:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788832041.777364:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788832041.777378:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788832041.777390:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1788832041.777436:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218318208:0@lo:502: 00000100:00100000:3.0:1788832041.777582:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832041.777704:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36d19840 going to sleep for 11 seconds 00000100:00100000:1.0:1788832041.777975:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218318208 00000100:00100000:1.0:1788832041.777985:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218318208 00000100:00100000:1.0:1788832041.778032:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788832041.778043:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+16:8433:x1875726218318208:12345-0@lo:502: 00000100:00100000:1.0:1788832041.778213:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+16:8433:x1875726218318208:12345-0@lo:502: Request processed in 171us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832041.778220:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788832041.778289:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218318208:0@lo:502: 00000040:00080000:3.0:1788832041.778347:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788832041.778358:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788832041.779316:0:8461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788832041.779332:0:8461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9d2c35828000) 00000020:00000080:3.0:1788832041.779355:0:8461:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788832041.779499:0:8461:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d2c3e677800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788832041.779504:0:8461:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d2c3e677800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788832041.779507:0:8461:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d2c3e677800 3 00010000:00080000:3.0:1788832041.779536:0:8461:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2c3e9ee800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1788832041.783614:0:8461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1788832041.783894:0:8461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788832041.783940:0:8461:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788832041.783954:0:8461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x998c12b283536d6a 00000100:00080000:2.0:1788832041.783965:0:8461:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788832041.783970:0:8461:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d2c3e9ee800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788832041.784008:0:8461:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c1fe27800 x1875726218318336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788832041.784034:0:8461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788832041.784273:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1875726218318336:0@lo:38: 00000100:00100000:3.0:1788832041.784342:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832041.784518:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218318336 00000100:00100000:2.0:1788832041.784525:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218318336 00000100:00100000:2.0:1788832041.784588:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788832041.784596:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1875726218318336:12345-0@lo:38: 00010000:00080000:2.0:1788832041.784648:0:6526:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:2.0:1788832041.784681:0:6526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x998c12b283536d71 00000004:00100000:2.0:1788832041.784696:0:6526:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788832041.784724:0:6526:0:(import.c:65:import_set_state_nolock()) ffff9d2b057d9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832041.784784:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875726218318336:12345-0@lo:38: Request processed in 187us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832041.784791:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788832041.788029:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218318848:0@lo:400: 00000100:00100000:1.0:1788832041.788096:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832041.788133:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788832041.788139:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218318464:0@lo:400: 00000100:00100000:1.0:1788832041.788164:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788832041.788604:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d2c1fe27800 x1875726218318336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788832051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832041.788646:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788832041.788657:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788832041.788666:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788832041.788672:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788832041.788676:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e9ee800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788832041.788683:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1875726218318336:0@lo:38: 00000100:00100000:3.0:1788832041.788718:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218318848 00000100:00100000:3.0:1788832041.788724:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218318848 00000100:00100000:3.0:1788832041.789048:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788832041.789059:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218318848:12345-0@lo:400: 00000100:00100000:3.0:1788832041.789124:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218318848:12345-0@lo:400: Request processed in 67us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832041.789131:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788832041.789237:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218318848:0@lo:400: 00000100:00100000:1.0:1788832041.789263:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218318720:0@lo:400: 00000100:00100000:1.0:1788832041.789291:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832041.791975:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218318464 00000100:00100000:2.0:1788832041.791990:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218318464 00000100:00100000:2.0:1788832041.792028:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218318592:0@lo:400: 00000100:00100000:2.0:1788832041.792104:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832041.794459:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788832041.794471:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218318464:12345-0@lo:400: 00000100:00100000:2.0:1788832041.794547:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218318464:12345-0@lo:400: Request processed in 78us (6382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832041.794554:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788832041.794592:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d2c18fe4700 x1875726218318464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832041.794607:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218318464:0@lo:400: 00000020:01000004:2.0:1788832041.794723:0:8461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788832041.794738:0:8461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9d2c3e77b370) 00000020:00000080:2.0:1788832041.794760:0:8461:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1788832041.794892:0:8461:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d2c3e677800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788832041.794896:0:8461:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d2c3e677800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788832041.794898:0:8461:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d2c3e677800 3 00010000:00080000:2.0:1788832041.794927:0:8461:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2b057d9800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1788832041.797139:0:8461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000100:00100000:1.0:1788832041.798187:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218318720 00000100:00100000:1.0:1788832041.798198:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218318720 00000100:00100000:1.0:1788832041.798242:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788832041.798252:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218318720:12345-0@lo:400: 00000100:00100000:1.0:1788832041.798326:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218318720:12345-0@lo:400: Request processed in 75us (9033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832041.798334:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788832041.798383:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d2c18fe5880 x1875726218318720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832041.798404:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218318720:0@lo:400: 00000100:00100000:0.0:1788832041.798599:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218318592 00000100:00100000:0.0:1788832041.798605:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218318592 00000020:00000080:3.0:1788832041.798812:0:8461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788832041.798868:0:8461:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788832041.798893:0:8461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x998c12b283536d7f 00000100:00080000:3.0:1788832041.798901:0:8461:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788832041.798906:0:8461:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9d2b057d9800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788832041.798933:0:8461:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c182a9c00 x1875726218318976/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788832041.798962:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1875726218318976:0@lo:38: 00000100:00100000:3.0:1788832041.799025:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832041.799068:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218318976 00000100:00100000:3.0:1788832041.799072:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218318976 00000100:00100000:3.0:1788832041.799093:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788832041.799099:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1875726218318976:12345-0@lo:38: 00010000:00080000:3.0:1788832041.799127:0:6525:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:3.0:1788832041.799165:0:6525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x998c12b283536d86 00000004:00100000:3.0:1788832041.799181:0:6525:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788832041.799210:0:6525:0:(import.c:65:import_set_state_nolock()) ffff9d2b064ca000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788832041.799250:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875726218318976:12345-0@lo:38: Request processed in 149us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832041.799257:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788832041.799286:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d2c182a9c00 x1875726218318976/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788832051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832041.799295:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788832041.799301:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788832041.799308:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788832041.799312:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788832041.799314:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2b057d9800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788832041.799320:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1875726218318976:0@lo:38: 00000100:00080000:3.0:1788832041.799339:0:8461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788832041.799823:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788832041.799842:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218318592:12345-0@lo:400: 00000100:00100000:0.0:1788832041.800066:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218318592:12345-0@lo:400: Request processed in 225us (7960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832041.800073:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000040:00080000:0.0:1788832041.801187:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788832041.801318:0:8433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788832041.801347:0:8433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788832041.801371:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b283536d55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536d5c expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.801383:0:8433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b283536d55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536d5c expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788832041.801433:0:8433:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788832041.801435:0:8433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788832041.801436:0:8433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832041.801438:0:8433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788832041.801439:0:8433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832041.801441:0:8433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832041.801442:0:8433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788832041.801444:0:8433:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788832041.801445:0:8433:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788832041.801447:0:8433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832041.801448:0:8433:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788832041.801452:0:8433:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788832041.801454:0:8433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788832041.801455:0:8433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788832041.801456:0:8433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832041.801458:0:8433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788832041.801459:0:8433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832041.801460:0:8433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832041.801461:0:8433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788832041.801462:0:8433:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788832041.801463:0:8433:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788832041.801464:0:8433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832041.801465:0:8433:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788832041.801486:0:8433:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788832041.801502:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218319104:0@lo:253: 00000100:00100000:1.0:1788832041.801566:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832041.801605:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218319104 00000100:00100000:1.0:1788832041.801611:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218319104 00000100:00100000:1.0:1788832041.801674:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788832041.801682:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+16:8433:x1875726218319104:12345-0@lo:253: 20000000:01000000:1.0:1788832041.801706:0:6518:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788832041.801721:0:6518:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788832041.801842:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0927f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832041.803962:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218318592:0@lo:400: 20000000:01000000:1.0:1788832041.809802:0:6518:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788832041.809822:0:6518:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788832041.810115:0:6541:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788832041.810127:0:6541:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788832041.810177:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536d8d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.810203:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c4204a000/0x998c12b283536c8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536c83 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.810212:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c092ddc00/0x998c12b283536cb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536cad expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.810234:0:6541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536d8d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.810289:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c092ddc00/0x998c12b283536cb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536cad expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.810308:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c092ddc00/0x998c12b283536cb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536cad expref: 16 pid: 6519 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832041.810326:0:6541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182a9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1875726218319232:0@lo:104: 00000100:00100000:3.0:1788832041.810420:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788832041.810486:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c4204a000/0x998c12b283536c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536c83 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.810495:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c4204a000/0x998c12b283536c8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536c83 expref: 16 pid: 6518 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832041.810504:0:6541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182aad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1875726218319360:0@lo:104: 00000100:00100000:1.0:1788832041.810541:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788832041.810569:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218319232 00000100:00100000:1.0:1788832041.810579:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218319232 00000100:00100000:1.0:1788832041.810669:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788832041.810680:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e568450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+3:6541:x1875726218319232:12345-0@lo:104: 00010000:00010000:1.0:1788832041.810698:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc400/0x998c12b283536cad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536cb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832041.811025:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788832041.811033:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e568450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+3:6541:x1875726218319232:12345-0@lo:104: Request processed in 355us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832041.811041:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1788832041.811239:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832041.811247:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc400/0x998c12b283536cad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536cb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.811254:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc400 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:0.0:1788832041.811258:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc400/0x998c12b283536cad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536cb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.811267:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc400/0x998c12b283536cad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536cb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832041.811288:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc400/0x998c12b283536cad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536cb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832041.811293:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788832041.811334:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc400/0x998c12b283536cad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536cb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.811341:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832041.811363:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc400/0x998c12b283536cad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536cb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.811371:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc400/0x998c12b283536cad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536cb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.811384:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832041.811386:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832041.811387:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832041.811557:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+16:8433:x1875726218319104:12345-0@lo:253: Request processed in 9874us (9990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832041.811565:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788832041.812277:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832041.812333:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:8433:1875726218319104:0@lo:253: 10000000:01000000:1.0:1788832041.812352:0:8433:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788832041.812355:0:8433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788832041.812357:0:8433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788832041.812358:0:8433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832041.812360:0:8433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788832041.812361:0:8433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:3.0:1788832041.812367:0:6541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36d19180 going to sleep for 11 seconds 00000020:01000004:1.0:1788832041.812376:0:8433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832041.812379:0:8433:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788832041.812381:0:8433:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788832041.812382:0:8433:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788832041.812385:0:8433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832041.812387:0:8433:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788832041.812403:0:8433:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788832041.812583:0:6541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182a9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1875726218319232:0@lo:104: 00000100:00100000:3.0:1788832041.812648:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218319488:0@lo:103: 00000100:00100000:0.0:1788832041.812662:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218319360 00000100:00100000:0.0:1788832041.812671:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218319360 00000100:00100000:0.0:1788832041.812714:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788832041.812724:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+3:6541:x1875726218319360:12345-0@lo:104: 00010000:00010000:0.0:1788832041.812736:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c4204ba00/0x998c12b283536c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536c8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832041.812783:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832041.812840:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788832041.812848:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+3:6541:x1875726218319360:12345-0@lo:104: Request processed in 125us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832041.812880:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788832041.812902:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832041.812919:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c4204ba00/0x998c12b283536c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536c8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.812927:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c4204ba00 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:0.0:1788832041.812931:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c4204ba00/0x998c12b283536c83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536c8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.812938:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c4204ba00/0x998c12b283536c83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536c8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832041.812945:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c4204ba00/0x998c12b283536c83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536c8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832041.812950:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788832041.812980:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c4204ba00/0x998c12b283536c83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536c8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.812986:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832041.813003:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c4204ba00/0x998c12b283536c83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536c8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.813010:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c4204ba00/0x998c12b283536c83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536c8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.813026:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832041.813028:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832041.813029:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832041.813814:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218319488 00000100:00100000:3.0:1788832041.813836:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218319488 00010000:00010000:3.0:1788832041.813880:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c092ddc00/0x998c12b283536cb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536cad expref: 16 pid: 6519 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832041.814293:0:6541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182aad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1875726218319360:0@lo:104: 00000100:00100000:3.0:1788832041.814316:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788832041.814332:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+16:3654:x1875726218319488:12345-0@lo:103: 00010000:00010000:2.0:1788832041.814333:0:6541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536d8d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.814358:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832041.814368:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c092ddc00/0x998c12b283536cb4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536cad expref: 16 pid: 6519 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.814383:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c092ddc00/0x998c12b283536cb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536cad expref: 16 pid: 6519 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.815506:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c092ddc00/0x998c12b283536cb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536cad expref: 16 pid: 6519 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832041.815532:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832041.815664:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+15:3654:x1875726218319488:12345-0@lo:103: Request processed in 1336us (2881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832041.815674:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788832041.815731:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218319616:0@lo:103: 00000100:00100000:3.0:1788832041.815795:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832041.815871:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218319616 00000100:00100000:0.0:1788832041.815900:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218319616 00010000:00010000:0.0:1788832041.815948:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c4204a000/0x998c12b283536c8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536c83 expref: 15 pid: 6518 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832041.815990:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788832041.816003:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e55f0905-9d39-4464-9830-326b420fb582+15:3651:x1875726218319616:12345-0@lo:103: 00010000:00010000:0.0:1788832041.816016:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832041.816021:0:7466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c4204a000/0x998c12b283536c8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536c83 expref: 15 pid: 6518 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.816032:0:7466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c4204a000/0x998c12b283536c8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536c83 expref: 15 pid: 6518 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832041.816037:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218319488:0@lo:103: 00010000:00010000:0.0:1788832041.816050:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c4204a000/0x998c12b283536c8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536c83 expref: 15 pid: 6518 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.816068:0:7466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536d8d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.816079:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536d8d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788832041.816097:0:7466:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005971267s 00010000:00010000:0.0:1788832041.816102:0:7466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536d8d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.816110:0:7466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536d8d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.816117:0:7466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536d8d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.816133:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536d8d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.816139:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2e00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:0.0:1788832041.816143:0:7466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536d8d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.816151:0:7466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536d8d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.816172:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536d8d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832041.816181:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832041.816245:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e55f0905-9d39-4464-9830-326b420fb582+14:3651:x1875726218319616:12345-0@lo:103: Request processed in 245us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832041.816251:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788832041.816320:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218319616:0@lo:103: 00010000:00010000:2.0:1788832041.816425:0:6541:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536d8d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832041.816433:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536d8d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832041.816440:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536d8d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788832041.830988:0:8433:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788832041.831450:0:8433:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788832041.831787:0:8433:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788832041.831961:0:8433:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788832041.832180:0:8433:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788832041.833483:0:8433:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788832041.836068:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788832041.849293:0:8433:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788832041.849305:0:8433:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788832041.849342:0:8433:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788832041.849393:0:8433:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788832041.849412:0:8433:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788832041.849450:0:8433:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788832041.850328:0:8433:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788832041.850483:0:8433:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788832042.455755:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832042.712281:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218319744:0@lo:41: 00000100:00100000:1.0:1788832042.712356:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832042.712496:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218319744 00000100:00100000:3.0:1788832042.712504:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218319744 00000100:00100000:3.0:1788832042.712554:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788832042.712563:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218319744:12345-0@lo:41: 00000004:00000024:3.0:1788832042.712599:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788832042.712786:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218319744:12345-0@lo:41: Request processed in 224us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832042.712809:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788832042.712893:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218319744:0@lo:41: 00000020:00000004:3.0:1788832042.734110:0:8517:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788832042.734352:0:8517:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788832043.222955:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218319872:0@lo:41: 00000100:00100000:1.0:1788832043.223031:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832043.223145:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218319872 00000100:00100000:0.0:1788832043.223155:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218319872 00000100:00100000:0.0:1788832043.223207:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788832043.223216:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218319872:12345-0@lo:41: 00000004:00000024:0.0:1788832043.223249:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1788832043.223299:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218319872:12345-0@lo:41: Request processed in 83us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832043.223307:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788832043.223718:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218319872:0@lo:41: 00010000:00010000:0.0:1788832043.480276:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832044.504879:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832045.528885:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832046.551290:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832046.821912:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218320128:0@lo:400: 00000100:00100000:1.0:1788832046.822063:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832046.822444:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218320000:0@lo:400: 00000100:00100000:3.0:1788832046.822788:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832046.823422:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218320384:0@lo:400: 00000100:00100000:2.0:1788832046.823491:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832046.823980:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218320640:0@lo:400: 00000100:00100000:0.0:1788832046.824419:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218320128 00000100:00100000:0.0:1788832046.824430:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218320128 00000100:00100000:0.0:1788832046.824494:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218320384 00000100:00100000:0.0:1788832046.824498:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218320384 00000100:00100000:0.0:1788832046.824516:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788832046.824525:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218320128:12345-0@lo:400: 00000100:00100000:3.0:1788832046.828262:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218320512:0@lo:400: 00000100:00100000:3.0:1788832046.828358:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832046.829503:0:6525:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788832046.829801:0:6525:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788832046.830227:0:6526:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788832046.830252:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788832046.830270:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218320384:12345-0@lo:400: 00000100:00100000:3.0:1788832046.830895:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218320384:12345-0@lo:400: Request processed in 628us (7399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832046.830906:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788832046.830963:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218320512 00000100:00100000:3.0:1788832046.830974:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218320512 00000100:00100000:3.0:1788832046.831023:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788832046.831031:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218320512:12345-0@lo:400: 00000100:00100000:3.0:1788832046.831089:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218320512:12345-0@lo:400: Request processed in 58us (2731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832046.831096:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788832046.831221:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218320512:0@lo:400: 00010000:00080000:2.0:1788832046.831825:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c18fe4700 x1875726218320384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832046.831840:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218320384:0@lo:400: 00000100:00100000:2.0:1788832046.832098:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218320256:0@lo:400: 00000100:00100000:1.0:1788832046.832502:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832046.840918:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832046.841013:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1875726218320768:0@lo:400: 00000100:00100000:2.0:1788832046.841188:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218320640 00000100:00100000:2.0:1788832046.841199:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218320640 00000100:00100000:2.0:1788832046.841288:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788832046.841301:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218320640:12345-0@lo:400: 00000100:00100000:2.0:1788832046.841378:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218320640:12345-0@lo:400: Request processed in 79us (8876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832046.841386:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788832046.841418:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218320000 00000100:00100000:2.0:1788832046.841422:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218320000 00000100:00100000:2.0:1788832046.841453:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788832046.841460:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+14:3654:x1875726218320000:12345-0@lo:400: 00000100:00100000:2.0:1788832046.841514:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+14:3654:x1875726218320000:12345-0@lo:400: Request processed in 55us (18994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832046.841520:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1788832046.843364:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832046.843473:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218320000:0@lo:400: 00000100:00100000:0.0:1788832046.843535:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218320128:12345-0@lo:400: Request processed in 19006us (21492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832046.843549:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788832046.844393:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b06613100 x1875726218320640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832046.844411:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218320640:0@lo:400: 00010000:00080000:1.0:1788832046.844444:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c18fe7100 x1875726218320128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832046.844454:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218320128:0@lo:400: 00000100:00100000:0.0:1788832046.844488:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832046.844760:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218320768 00000100:00100000:1.0:1788832046.844775:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218320768 00000100:00100000:1.0:1788832046.844861:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788832046.844871:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875726218320768:12345-0@lo:400: 00000100:00080000:0.0:1788832046.844887:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788832046.844965:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875726218320768:12345-0@lo:400: Request processed in 95us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832046.844973:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788832046.845018:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b06611c00 x1875726218320768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832046.845029:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1875726218320768:0@lo:400: 00000100:00100000:2.0:1788832046.846243:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218320256 00000100:00100000:2.0:1788832046.846259:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218320256 00000100:00100000:2.0:1788832046.846336:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788832046.846347:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218320256:12345-0@lo:400: 00000100:00100000:2.0:1788832046.847442:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218320256:12345-0@lo:400: Request processed in 1089us (6531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832046.847458:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788832046.847544:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218320256:0@lo:400: 00010000:00010000:3.0:1788832047.575118:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832047.836192:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218320896:0@lo:41: 00000100:00100000:1.0:1788832047.836261:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832047.836462:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218320896 00000100:00100000:1.0:1788832047.836470:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218320896 00000100:00100000:1.0:1788832047.836512:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788832047.836521:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218320896:12345-0@lo:41: 00000004:00000024:1.0:1788832047.836558:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788832047.838061:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218320896:12345-0@lo:41: Request processed in 1534us (1792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832047.838073:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788832047.838168:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218320896:0@lo:41: 00000001:02000400:1.0:1788832047.882000:0:8808:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788832048.345306:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832048.345332:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218321024:0@lo:41: 00000100:00100000:2.0:1788832048.345403:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832048.348700:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218321024 00000100:00100000:3.0:1788832048.348715:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218321024 00000100:00100000:3.0:1788832048.348800:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788832048.348813:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218321024:12345-0@lo:41: 00000004:00000024:3.0:1788832048.348869:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1788832048.348969:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218321024:12345-0@lo:41: Request processed in 158us (3565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832048.348977:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788832048.349700:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e776300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218321024:0@lo:41: 00010000:00010000:2.0:1788832048.601847:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788832048.797214:0:8860:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788832048.797465:0:8860:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788832049.626240:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788832049.878742:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788832049.878751:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d2c39185800 from 30 10000000:01000000:1.0:1788832049.878756:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788832049.878820:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536d94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832049.878850:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536d94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832049.878862:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536d94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832049.878886:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06611c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218321152:0@lo:101: 00000100:00100000:1.0:1788832049.878979:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832049.879049:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832049.879107:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218321152 00000100:00100000:0.0:1788832049.879115:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218321152 00000100:00100000:0.0:1788832049.879226:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788832049.879236:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+14:6522:x1875726218321152:12345-0@lo:101: 00010000:00010000:0.0:1788832049.879249:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832049.879262:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c00030600/0x998c12b283536d9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536d94 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832049.879298:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c00030600/0x998c12b283536d9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536d94 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832049.879368:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c00030600/0x998c12b283536d9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536d94 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832049.879380:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00030600, rc 0) 00000100:00100000:0.0:1788832049.879429:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+15:6522:x1875726218321152:12345-0@lo:101: Request processed in 195us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832049.879436:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788832049.879872:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06611c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218321152:0@lo:101: 00010000:00010000:1.0:1788832049.879888:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536d94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536d9b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832049.879898:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536d94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536d9b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832049.879985:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06611c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218321280:0@lo:501: 00000100:00100000:1.0:1788832049.880012:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832049.880043:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832049.881196:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218321280 00000100:00100000:2.0:1788832049.881208:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218321280 00000100:00100000:2.0:1788832049.881269:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788832049.881280:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:6522:x1875726218321280:12345-0@lo:501: 00000100:00100000:2.0:1788832049.881439:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:6522:x1875726218321280:12345-0@lo:501: Request processed in 161us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832049.881446:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788832049.881748:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06611c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218321280:0@lo:501: 00000100:00100000:1.0:1788832049.881803:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06611c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218321408:0@lo:503: 00000100:00100000:1.0:1788832049.881854:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832049.881886:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832049.883876:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218321408 00000100:00100000:2.0:1788832049.883889:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218321408 00000100:00100000:2.0:1788832049.883963:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788832049.883974:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+15:6522:x1875726218321408:12345-0@lo:503: 00000100:00100000:2.0:1788832049.884141:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+15:6522:x1875726218321408:12345-0@lo:503: Request processed in 168us (2285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832049.884156:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788832049.884371:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06611c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218321408:0@lo:503: 00000100:00100000:3.0:1788832049.886320:0:8912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182aad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:8912:1875726218321536:0@lo:502: 00000100:00100000:3.0:1788832049.886401:0:8912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832049.886447:0:8912:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0304e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788832049.886472:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218321536 00000100:00100000:0.0:1788832049.886480:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218321536 00000100:00100000:0.0:1788832049.886586:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788832049.886597:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+15:8912:x1875726218321536:12345-0@lo:502: 00000100:00100000:0.0:1788832049.886756:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+15:8912:x1875726218321536:12345-0@lo:502: Request processed in 160us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832049.886764:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788832049.886864:0:8912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182aad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:8912:1875726218321536:0@lo:502: 00000100:00100000:3.0:1788832049.886909:0:8912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182aad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:8912:1875726218321664:0@lo:502: 00000100:00100000:3.0:1788832049.886942:0:8912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832049.887733:0:8912:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0304e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788832049.888076:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218321664 00000100:00100000:2.0:1788832049.888084:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218321664 00000100:00100000:2.0:1788832049.888120:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788832049.888129:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+15:8912:x1875726218321664:12345-0@lo:502: 00000100:00100000:2.0:1788832049.888429:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+15:8912:x1875726218321664:12345-0@lo:502: Request processed in 183us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832049.888438:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788832049.888787:0:8912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182aad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:8912:1875726218321664:0@lo:502: 00000040:00080000:3.0:1788832049.888820:0:8912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788832049.888994:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788832049.889022:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788832049.889033:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536d94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536d9b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832049.889045:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536d94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536d9b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832049.889054:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788832049.889057:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d2c39185800 from 5 10000000:01000000:0.0:1788832049.889060:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788832049.889099:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c00031c00/0x998c12b283536da2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832049.889107:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c00031c00/0x998c12b283536da2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832049.889118:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c00031c00/0x998c12b283536da2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832049.889148:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e774700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218321792:0@lo:101: 00000100:00100000:0.0:1788832049.889199:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832049.889225:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c391163c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832049.889401:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218321792 00000100:00100000:2.0:1788832049.889407:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218321792 00000100:00100000:2.0:1788832049.889446:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788832049.889454:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+15:6522:x1875726218321792:12345-0@lo:101: 00010000:00010000:2.0:1788832049.889466:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832049.889480:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c092dde00/0x998c12b283536da9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536da2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832049.889502:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c092dde00/0x998c12b283536da9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536da2 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832049.889513:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c092dde00/0x998c12b283536da9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536da2 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832049.889523:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dde00, rc 0) 00000100:00100000:2.0:1788832049.889665:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218321792:12345-0@lo:101: Request processed in 210us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832049.889672:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788832049.889837:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e774700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218321792:0@lo:101: 00010000:00010000:3.0:1788832049.889854:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c00031c00/0x998c12b283536da2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536da9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832049.889864:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c00031c00/0x998c12b283536da2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536da9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832049.889915:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218321920:0@lo:256: 00000100:00100000:3.0:1788832049.889946:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832049.889969:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0304e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788832049.890021:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218321920 00000100:00100000:0.0:1788832049.890025:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218321920 00000100:00100000:0.0:1788832049.890057:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788832049.890065:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218321920:12345-0@lo:256: 20000000:01000000:0.0:1788832049.890079:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788832049.890096:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788832049.890100:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788832049.890190:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218321920:12345-0@lo:256: Request processed in 125us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832049.890197:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788832049.890447:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218321920:0@lo:256: 10000000:01000000:3.0:1788832049.890491:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788832049.890498:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c00031c00/0x998c12b283536da2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536da9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832049.890507:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c00031c00/0x998c12b283536da2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536da9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832049.890515:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788832049.890517:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1788832049.890519:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788832049.890612:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283536db0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832049.890651:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283536db0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832049.890661:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283536db0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832049.890675:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218322048:0@lo:101: 00000100:00100000:3.0:1788832049.890702:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832049.890721:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0304e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788832049.890778:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218322048 00000100:00100000:0.0:1788832049.890784:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218322048 00000100:00100000:0.0:1788832049.890815:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788832049.890821:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218322048:12345-0@lo:101: 00010000:00010000:0.0:1788832049.890832:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832049.890842:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c00030c00/0x998c12b283536db7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536db0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832049.890870:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c00030c00/0x998c12b283536db7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536db0 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832049.890878:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c00030c00/0x998c12b283536db7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536db0 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832049.890886:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00030c00, rc 0) 00000100:00100000:0.0:1788832049.890988:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218322048:12345-0@lo:101: Request processed in 166us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832049.890995:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788832049.891107:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218322048:0@lo:101: 00010000:00010000:2.0:1788832049.891126:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283536db0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536db7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832049.891134:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283536db0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536db7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832049.891393:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218322176:0@lo:501: 00000100:00100000:2.0:1788832049.891420:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832049.892798:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832049.894331:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218322176 00000100:00100000:3.0:1788832049.894344:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218322176 00000100:00100000:3.0:1788832049.894409:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788832049.894419:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218322176:12345-0@lo:501: 00000100:00100000:3.0:1788832049.895215:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218322176:12345-0@lo:501: Request processed in 794us (3789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832049.895243:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788832049.895465:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218322176:0@lo:501: 00000100:00100000:0.0:1788832049.895525:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e775180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218322304:0@lo:503: 00000100:00100000:0.0:1788832049.895586:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832049.895644:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c39116600 going to sleep for 11 seconds 00000100:00100000:1.0:1788832049.895707:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218322304 00000100:00100000:1.0:1788832049.895718:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218322304 00000100:00100000:1.0:1788832049.895758:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788832049.895766:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218322304:12345-0@lo:503: 00000100:00100000:1.0:1788832049.895892:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218322304:12345-0@lo:503: Request processed in 126us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832049.895899:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788832049.896152:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e775180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218322304:0@lo:503: 00000100:00100000:1.0:1788832049.896778:0:8913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06611c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:8913:1875726218322432:0@lo:502: 00000100:00100000:1.0:1788832049.896835:0:8913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832049.896883:0:8913:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832049.897055:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218322432 00000100:00100000:3.0:1788832049.897061:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218322432 00000100:00100000:3.0:1788832049.897105:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788832049.897113:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:8913:x1875726218322432:12345-0@lo:502: 00000100:00100000:3.0:1788832049.897252:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:8913:x1875726218322432:12345-0@lo:502: Request processed in 139us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832049.897259:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788832049.897478:0:8913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06611c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:8913:1875726218322432:0@lo:502: 00000020:01000000:0.0:1788832049.897507:0:8913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788832049.897515:0:8913:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788832049.897522:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832049.897525:0:8913:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788832049.897529:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788832049.897533:0:8913:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:0.0:1788832049.897565:0:8913:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788832049.897568:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788832049.897583:0:8913:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9d2b06008000) 00000020:00000080:0.0:1788832049.897605:0:8913:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1788832049.897611:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788832049.897739:0:8913:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788832049.897747:0:8913:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788832049.897757:0:8913:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x998c12b283536dc5 00010000:00080000:0.0:1788832049.897804:0:8913:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2c36c4d800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:0.0:1788832049.898024:0:8913:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788832049.915233:0:8913:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788832049.915510:0:8913:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788832049.916089:0:8913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788832049.916536:0:8913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788832049.917675:0:8913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788832049.917796:0:8913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788832049.918838:0:8914:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832049.918844:0:8914:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788832049.921755:0:8913:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788832049.921782:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788832049.921825:0:8913:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788832049.921851:0:8913:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x998c12b283536dcc 00000100:00080000:0.0:1788832049.921864:0:8913:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788832049.923295:0:8913:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9d2c36c4d800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788832049.923345:0:8913:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c3e775880 x1875726218322560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788832049.923434:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218322560:0@lo:8: 00000100:00100000:3.0:1788832049.923515:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788832049.923602:0:8913:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788832049.923733:0:8913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832049.923740:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832049.923742:0:8913:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788832049.923745:0:8913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832049.923749:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832049.923750:0:8913:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788832049.923753:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788832049.923755:0:8913:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788832049.923791:0:8913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e775180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:8913:1875726218322688:0@lo:502: 00000100:00100000:0.0:1788832049.923855:0:8913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832049.923899:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218322688 00000100:00100000:0.0:1788832049.923906:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218322688 00000100:00100000:0.0:1788832049.923947:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788832049.923961:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+17:8913:x1875726218322688:12345-0@lo:502: 00000100:00100000:0.0:1788832049.924078:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+17:8913:x1875726218322688:12345-0@lo:502: Request processed in 118us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832049.924086:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788832049.924128:0:8913:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c05c13c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788832049.924147:0:8913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e775180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:8913:1875726218322688:0@lo:502: 00000020:01000000:0.0:1788832049.924170:0:8913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832049.924174:0:8913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832049.924176:0:8913:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788832049.924179:0:8913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:2.0:1788832049.924380:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218322560 00000100:00100000:2.0:1788832049.924385:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218322560 00000100:00100000:2.0:1788832049.924415:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788832049.924421:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1875726218322560:12345-0@lo:8: 00010000:00080000:2.0:1788832049.924446:0:8440:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:2.0:1788832049.924478:0:8440:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x998c12b283536dd3 00002000:00100000:2.0:1788832049.924517:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9d2b057dd000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788832049.924522:0:8440:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1788832049.924526:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788832049.924580:0:8440:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788832049.924854:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788832049.924879:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9d2b057d8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788832049.925181:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218322816:0@lo:400: 00000100:00100000:1.0:1788832049.925218:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832049.925248:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218323328:0@lo:400: 00000100:00100000:1.0:1788832049.925268:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832049.925287:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788832049.925293:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218322944:0@lo:400: 00000100:00100000:1.0:1788832049.925315:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832049.925329:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218323456:0@lo:400: 00000100:00100000:1.0:1788832049.925346:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832049.925366:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218323200:0@lo:400: 00000100:00100000:1.0:1788832049.925386:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832049.925403:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832049.925408:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875726218323072:0@lo:400: 00000100:00100000:1.0:1788832049.925426:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832049.925447:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218322816 00000100:00100000:1.0:1788832049.925451:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218322816 00000100:00100000:1.0:1788832049.925475:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218323328 00000100:00100000:1.0:1788832049.925483:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218323328 00000100:00100000:1.0:1788832049.925505:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218323456 00000100:00100000:1.0:1788832049.925508:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218323456 00000100:00100000:1.0:1788832049.925519:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218323072 00000100:00100000:1.0:1788832049.925521:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218323072 00000100:00100000:1.0:1788832049.925533:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788832049.925539:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218322816:12345-0@lo:400: 00000100:00100000:1.0:1788832049.925578:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218322816:12345-0@lo:400: Request processed in 39us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832049.925584:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788832049.925597:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788832049.925602:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218323328:12345-0@lo:400: 00000100:00100000:1.0:1788832049.925647:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218323328:12345-0@lo:400: Request processed in 45us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832049.925653:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788832049.925664:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788832049.925670:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218323456:12345-0@lo:400: 00000100:00100000:1.0:1788832049.925692:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218323456:12345-0@lo:400: Request processed in 24us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832049.925698:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788832049.925708:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788832049.925714:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875726218323072:12345-0@lo:400: 00000100:00100000:1.0:1788832049.925740:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875726218323072:12345-0@lo:400: Request processed in 26us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832049.925745:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788832049.925760:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218322944 00000100:00100000:1.0:1788832049.925763:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218322944 00000100:00100000:1.0:1788832049.925804:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218323200 00000100:00100000:1.0:1788832049.925807:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218323200 00000100:00100000:1.0:1788832049.925819:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788832049.925824:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218322944:12345-0@lo:400: 00000100:00100000:1.0:1788832049.925855:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218322944:12345-0@lo:400: Request processed in 31us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832049.925860:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788832049.925869:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788832049.925875:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218323200:12345-0@lo:400: 00000100:00100000:1.0:1788832049.925898:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218323200:12345-0@lo:400: Request processed in 22us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832049.925903:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788832049.925920:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788832049.925924:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788832049.925949:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b06612300 x1875726218323072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832049.925966:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875726218323072:0@lo:400: 00000100:00100000:1.0:1788832049.925976:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218323200:0@lo:400: 00000100:00100000:1.0:1788832049.926002:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218322944:0@lo:400: 00010000:00080000:1.0:1788832049.926011:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b06611880 x1875726218323456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832049.926019:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218323456:0@lo:400: 00010000:00080000:1.0:1788832049.926028:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b06610e00 x1875726218322816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832049.926035:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218322816:0@lo:400: 00010000:00080000:1.0:1788832049.926052:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b06611180 x1875726218323328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832049.926060:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218323328:0@lo:400: 00000020:01000000:1.0:1788832049.926131:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1788832049.926157:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788832049.926168:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283536db0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536db7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832049.926179:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283536db0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536db7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832049.926188:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788832049.926191:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d2c40623800 from 30 10000000:01000000:1.0:1788832049.926194:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788832049.926219:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3600/0x998c12b283536dda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832049.926227:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3600/0x998c12b283536dda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832049.926236:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3600/0x998c12b283536dda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832049.926250:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218323584:0@lo:101: 00000100:00100000:1.0:1788832049.926277:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832049.926301:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788832049.926313:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218323584 00000100:00100000:1.0:1788832049.926316:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218323584 00000100:00100000:1.0:1788832049.926340:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788832049.926352:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218323584:12345-0@lo:101: 00010000:00010000:1.0:1788832049.926361:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832049.926372:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c390f3e00/0x998c12b283536de1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536dda expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832049.926391:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c390f3e00/0x998c12b283536de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536dda expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832049.926402:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c390f3e00/0x998c12b283536de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536dda expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832049.926410:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c390f3e00, rc 0) 00000100:00100000:1.0:1788832049.926436:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+18:6522:x1875726218323584:12345-0@lo:101: Request processed in 85us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832049.926442:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788832049.926473:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218323584:0@lo:101: 00010000:00010000:1.0:1788832049.926486:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3600/0x998c12b283536dda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536de1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832049.926495:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3600/0x998c12b283536dda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536de1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832049.926540:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218323712:0@lo:501: 00000100:00100000:1.0:1788832049.926563:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832049.926574:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788832049.926585:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218323712 00000100:00100000:1.0:1788832049.926588:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218323712 00000100:00100000:1.0:1788832049.926606:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788832049.926612:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+18:6522:x1875726218323712:12345-0@lo:501: 00000100:00100000:1.0:1788832049.927411:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+18:6522:x1875726218323712:12345-0@lo:501: Request processed in 794us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832049.927420:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788832049.927607:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06611180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218323712:0@lo:501: 00000100:00100000:0.0:1788832049.927717:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e775180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218323840:0@lo:503: 00000100:00100000:0.0:1788832049.927764:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832049.927836:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c391160c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832049.927972:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218323840 00000100:00100000:1.0:1788832049.927977:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218323840 00000100:00100000:1.0:1788832049.928048:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788832049.928056:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+18:6522:x1875726218323840:12345-0@lo:503: 00000100:00100000:1.0:1788832049.928146:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+18:6522:x1875726218323840:12345-0@lo:503: Request processed in 91us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832049.928153:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788832049.928207:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875726218322560:12345-0@lo:8: Request processed in 3783us (4690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832049.928215:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788832049.928289:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e775180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218323840:0@lo:503: 00010000:00080000:3.0:1788832049.929015:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3e775880 x1875726218322560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788832059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832049.929030:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788832049.929039:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788832049.929047:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788832049.929053:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788832049.929058:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c36c4d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788832049.929133:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788832049.929141:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218322560:0@lo:8: 00000004:00080000:0.0:1788832049.929214:0:8914:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788832049.929283:0:8914:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 189969661701ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788832049.929290:0:8914:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788832049.930200:0:8915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06610e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8915:1875726218323968:0@lo:700: 00000100:00100000:1.0:1788832049.930268:0:8915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832049.930340:0:8915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f5180 going to sleep for 11 seconds 00000100:00100000:0.0:1788832049.930448:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218323968 00000100:00100000:0.0:1788832049.930456:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218323968 00000100:00100000:0.0:1788832049.930560:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788832049.930570:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8915:x1875726218323968:12345-0@lo:700: 00000100:00100000:0.0:1788832049.930609:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e775180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8448:1875726218324096:0@lo:700: 00000100:00100000:0.0:1788832049.930707:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832049.930727:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c05c13c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788832049.930741:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218324096 00000100:00100000:0.0:1788832049.930744:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218324096 00000100:00100000:0.0:1788832049.930790:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788832049.930797:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8448:x1875726218324096:12345-0@lo:700: 00000100:00080000:1.0:1788832049.932165:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788832049.932309:0:7456:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788832049.933052:0:8916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe26680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:8916:1875726218324224:0@lo:502: 00000100:00100000:2.0:1788832049.933130:0:8916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832049.933274:0:8916:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788832049.933325:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218324224 00000100:00100000:1.0:1788832049.933332:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218324224 00000100:00100000:1.0:1788832049.933422:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788832049.933432:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+18:8916:x1875726218324224:12345-0@lo:502: 00000100:00100000:1.0:1788832049.933572:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+18:8916:x1875726218324224:12345-0@lo:502: Request processed in 140us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832049.933580:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788832049.933662:0:8916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe26680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:8916:1875726218324224:0@lo:502: 00000100:00100000:2.0:1788832049.933720:0:8916:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe26680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:8916:1875726218324352:0@lo:502: 00000100:00100000:2.0:1788832049.933750:0:8916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832049.934193:0:8916:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788832049.934263:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218324352 00000100:00100000:0.0:1788832049.934268:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218324352 00000100:00100000:0.0:1788832049.934297:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788832049.934304:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+18:8916:x1875726218324352:12345-0@lo:502: 00000100:00100000:0.0:1788832049.934403:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+18:8916:x1875726218324352:12345-0@lo:502: Request processed in 98us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832049.934409:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788832049.934495:0:8916:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe26680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:8916:1875726218324352:0@lo:502: 00000040:00080000:2.0:1788832049.934520:0:8916:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788832049.934848:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788832049.934885:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788832049.934896:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3600/0x998c12b283536dda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536de1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832049.934907:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3600/0x998c12b283536dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536de1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832049.934917:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788832049.934920:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d2c40623800 from 5 10000000:01000000:0.0:1788832049.934923:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788832049.934953:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536de8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832049.934961:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536de8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832049.934981:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536de8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832049.935000:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e776300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218324480:0@lo:101: 00000100:00100000:0.0:1788832049.935035:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832049.935061:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c391160c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832049.935075:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218324480 00000100:00100000:0.0:1788832049.935078:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218324480 00000100:00100000:0.0:1788832049.935099:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788832049.935105:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+18:6522:x1875726218324480:12345-0@lo:101: 00010000:00010000:0.0:1788832049.935115:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832049.935136:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c36db8e00/0x998c12b283536def lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536de8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832049.935158:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c36db8e00/0x998c12b283536def lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536de8 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832049.935168:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c36db8e00/0x998c12b283536def lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536de8 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832049.935176:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c36db8e00, rc 0) 00000100:00100000:0.0:1788832049.935205:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+19:6522:x1875726218324480:12345-0@lo:101: Request processed in 99us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832049.935212:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788832049.935243:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e776300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218324480:0@lo:101: 00010000:00010000:0.0:1788832049.935255:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536de8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536def expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832049.935273:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536de8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536def expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832049.935312:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e776300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218324608:0@lo:256: 00000100:00100000:0.0:1788832049.935340:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832049.935352:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36dd46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832049.935362:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218324608 00000100:00100000:0.0:1788832049.935365:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218324608 00000100:00100000:0.0:1788832049.935381:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788832049.935386:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+19:6522:x1875726218324608:12345-0@lo:256: 20000000:01000000:0.0:1788832049.935398:0:6518:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788832049.935412:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788832049.935415:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788832049.935482:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+19:6522:x1875726218324608:12345-0@lo:256: Request processed in 95us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832049.935489:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788832049.935514:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e776300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218324608:0@lo:256: 10000000:01000000:0.0:1788832049.936505:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788832049.936516:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536de8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536def expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832049.936525:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536de8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536def expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832049.936532:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788832049.936534:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788832049.936820:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788832049.936982:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8800/0x998c12b283536df6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832049.936996:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8800/0x998c12b283536df6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832049.937006:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8800/0x998c12b283536df6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832049.937022:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e776300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218324736:0@lo:101: 00000100:00100000:0.0:1788832049.937069:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832049.937107:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36dd46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832049.937262:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218324736 00000100:00100000:1.0:1788832049.937268:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218324736 00000100:00100000:1.0:1788832049.937312:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788832049.937321:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+19:6522:x1875726218324736:12345-0@lo:101: 00010000:00010000:1.0:1788832049.937332:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832049.937342:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c390f3a00/0x998c12b283536dfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536df6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832049.937384:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c390f3a00/0x998c12b283536dfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536df6 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832049.937393:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c390f3a00/0x998c12b283536dfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536df6 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832049.937401:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c390f3a00, rc 0) 00000100:00100000:1.0:1788832049.937437:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+20:6522:x1875726218324736:12345-0@lo:101: Request processed in 117us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832049.937443:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788832049.945234:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e776300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218324736:0@lo:101: 00010000:00010000:1.0:1788832049.945267:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8800/0x998c12b283536df6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536dfd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832049.945278:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8800/0x998c12b283536df6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536dfd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832049.945381:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06610a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218324864:0@lo:501: 00000100:00100000:1.0:1788832049.945478:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832049.946140:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f5000 going to sleep for 11 seconds 00000100:00100000:2.0:1788832049.948388:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218324864 00000100:00100000:2.0:1788832049.948405:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218324864 00000100:00100000:2.0:1788832049.948468:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788832049.948479:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+20:6522:x1875726218324864:12345-0@lo:501: 00000100:00100000:2.0:1788832049.948953:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+20:6522:x1875726218324864:12345-0@lo:501: Request processed in 474us (3473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832049.948961:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788832049.949031:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06610a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218324864:0@lo:501: 00000100:00100000:3.0:1788832049.949104:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218324992:0@lo:503: 00000100:00100000:3.0:1788832049.949162:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832049.949442:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c07c4a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788832049.949502:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218324992 00000100:00100000:1.0:1788832049.949508:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218324992 00000100:00100000:1.0:1788832049.949545:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788832049.949553:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+20:6522:x1875726218324992:12345-0@lo:503: 00000100:00100000:1.0:1788832049.949761:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+20:6522:x1875726218324992:12345-0@lo:503: Request processed in 208us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832049.949782:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788832049.949796:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218324992:0@lo:503: 40000000:02000000:2.0:1788832049.950144:0:6532:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1788832049.954524:0:8917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06610700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:8917:1875726218325120:0@lo:502: 00000100:00100000:1.0:1788832049.954799:0:8917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832049.954883:0:8917:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788832049.954930:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218325120 00000100:00100000:3.0:1788832049.954939:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218325120 00000100:00100000:3.0:1788832049.955025:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788832049.955035:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+20:8917:x1875726218325120:12345-0@lo:502: 00000100:00100000:3.0:1788832049.955196:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+20:8917:x1875726218325120:12345-0@lo:502: Request processed in 162us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832049.955204:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788832049.955303:0:8917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06610700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:8917:1875726218325120:0@lo:502: 00000020:01000000:0.0:1788832049.955335:0:8917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788832049.955342:0:8917:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788832049.955349:0:8917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832049.955352:0:8917:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788832049.955356:0:8917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788832049.955360:0:8917:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:0.0:1788832049.955385:0:8917:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788832049.955388:0:8917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788832049.955406:0:8917:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9d2b060099b8) 00000020:00000080:0.0:1788832049.955431:0:8917:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1788832049.955436:0:8917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788832049.955512:0:8917:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788832049.955518:0:8917:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788832049.955525:0:8917:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x998c12b283536e0b 00010000:00080000:0.0:1788832049.955558:0:8917:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2c3e9ec000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.126@tcp at head 00010000:00010000:0.0:1788832049.955864:0:8917:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:3.0:1788832049.958240:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8448:x1875726218324096:12345-0@lo:700: Request processed in 27430us (27519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832049.958257:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788832049.958462:0:8448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3e775180 x1875726218324096/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788832065 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832049.958491:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e775180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8448:1875726218324096:0@lo:700: 40000000:02000000:0.0:1788832049.958505:0:8448:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000001:00100000:2.0:1788832049.975212:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000040:01000000:2.0:1788832049.977458:0:8917:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788832049.977487:0:8917:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788832049.977740:0:8917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788832049.977950:0:8917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788832049.978041:0:8917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000100:00100000:0.0:1788832049.978471:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8915:x1875726218323968:12345-0@lo:700: Request processed in 47898us (48198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832049.978483:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788832049.978703:0:8915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b06610e00 x1875726218323968/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788832065 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832049.978720:0:8915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06610e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8915:1875726218323968:0@lo:700: 00000040:00080000:2.0:1788832049.979002:0:8917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788832049.980870:0:8918:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788832049.980877:0:8918:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788832049.981995:0:8917:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788832049.982007:0:8917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788832049.982061:0:8917:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788832049.982160:0:8917:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x998c12b283536e12 00000100:00080000:2.0:1788832049.982227:0:8917:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788832049.982233:0:8917:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d2c3e9ec000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788832049.982333:0:8917:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c1fe26680 x1875726218325248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788832049.982359:0:8917:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788832049.982471:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218325248:0@lo:8: 00000100:00100000:3.0:1788832049.982538:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788832049.982804:0:8917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832049.982809:0:8917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832049.982811:0:8917:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788832049.982815:0:8917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832049.982819:0:8917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832049.982820:0:8917:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788832049.982823:0:8917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788832049.982825:0:8917:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788832049.982849:0:8917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:8917:1875726218325376:0@lo:502: 00000100:00100000:0.0:1788832049.983007:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218325248 00000100:00100000:0.0:1788832049.983015:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218325248 00000100:00100000:0.0:1788832049.983055:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788832049.983064:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1875726218325248:12345-0@lo:8: 00010000:00080000:0.0:1788832049.983099:0:8442:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1788832049.983127:0:8442:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x998c12b283536e19 00002000:00100000:0.0:1788832049.983141:0:8442:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9d2b06000000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788832049.983144:0:8442:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788832049.983147:0:8442:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788832049.983259:0:8442:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788832049.983287:0:8442:0:(import.c:65:import_set_state_nolock()) ffff9d2b06005800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832049.983762:0:8917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832049.983842:0:8917:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b4780 going to sleep for 11 seconds 00000100:00100000:1.0:1788832049.983983:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218325632:0@lo:400: 00000100:00100000:1.0:1788832049.984014:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832049.984034:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218326144:0@lo:400: 00000100:00100000:2.0:1788832049.984150:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218325504:0@lo:400: 00000100:00100000:1.0:1788832049.984292:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832049.984342:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218325760:0@lo:400: 00000100:00100000:1.0:1788832049.984433:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832049.984456:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218326272:0@lo:400: 00000100:00100000:1.0:1788832049.984482:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832049.984502:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788832049.984508:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218325888:0@lo:400: 00000100:00100000:1.0:1788832049.984528:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832049.984558:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218325632 00000100:00100000:0.0:1788832049.984719:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875726218325248:12345-0@lo:8: Request processed in 1652us (2179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832049.984729:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788832049.984751:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218326272 00000100:00100000:0.0:1788832049.984756:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218326272 00000100:00100000:0.0:1788832049.984804:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788832049.984813:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218326272:12345-0@lo:400: 00000100:00100000:0.0:1788832049.984856:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218326272:12345-0@lo:400: Request processed in 45us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832049.984874:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788832049.984925:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b06611c00 x1875726218326272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832049.984938:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218326272:0@lo:400: 00000100:00100000:1.0:1788832049.985032:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218325632 00000100:00100000:1.0:1788832049.985059:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218325888 00000100:00100000:1.0:1788832049.985062:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218325888 00000100:00100000:2.0:1788832049.985208:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218326144 00000100:00100000:2.0:1788832049.985213:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218326144 00000100:00100000:2.0:1788832049.985362:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218325760 00000100:00100000:2.0:1788832049.985422:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218325760 00000100:00100000:2.0:1788832049.985448:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788832049.985456:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218326144:12345-0@lo:400: 00000100:00100000:2.0:1788832049.985501:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218326144:12345-0@lo:400: Request processed in 46us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832049.985507:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788832049.985521:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788832049.985527:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218325760:12345-0@lo:400: 00000100:00100000:3.0:1788832049.985542:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218325376 00000100:00100000:3.0:1788832049.985546:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218325376 00000100:00100000:3.0:1788832049.985579:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788832049.985587:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+20:8917:x1875726218325376:12345-0@lo:502: 00000100:00100000:2.0:1788832049.985657:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218325760:12345-0@lo:400: Request processed in 130us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832049.985663:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788832049.985742:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+20:8917:x1875726218325376:12345-0@lo:502: Request processed in 155us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832049.985748:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788832049.985793:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788832049.985803:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218325632:12345-0@lo:400: 00000100:00100000:1.0:1788832049.985848:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218325632:12345-0@lo:400: Request processed in 47us (1832us total) trans 0 rc 0/0 00010000:00080000:2.0:1788832049.985874:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b06611180 x1875726218326144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788832049.985877:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c1fe26680 x1875726218325248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788832059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832049.985886:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:2.0:1788832049.985886:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218326144:0@lo:400: 00000100:00080000:3.0:1788832049.985893:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788832049.985901:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:2.0:1788832049.985905:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218325632:0@lo:400: 00000100:00080000:3.0:1788832049.985906:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788832049.985909:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e9ec000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788832049.985921:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788832049.985927:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218325248:0@lo:8: 00000004:00080000:2.0:1788832049.985929:0:8918:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788832049.985952:0:8917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:8917:1875726218325376:0@lo:502: 00000020:01000000:3.0:1788832049.985979:0:8917:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832049.985987:0:8917:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000004:00080000:2.0:1788832049.985988:0:8918:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 190026367266ns, next at 0ns, rc = 0 00000020:00000080:3.0:1788832049.985989:0:8917:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788832049.985993:0:8917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00080000:00080000:2.0:1788832049.985994:0:8918:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:3.0:1788832049.986051:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788832049.986075:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788832049.986084:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8800/0x998c12b283536df6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536dfd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832049.986094:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8800/0x998c12b283536df6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536dfd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832049.986103:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788832049.986106:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d2c18e319b8 from 1 10000000:01000000:3.0:1788832049.986109:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788832049.986133:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2400/0x998c12b283536e20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832049.986140:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2400/0x998c12b283536e20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832049.986147:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2400/0x998c12b283536e20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832049.986163:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218326400:0@lo:101: 00000100:00100000:3.0:1788832049.986193:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832049.986225:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c04fdbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832049.986238:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218326400 00000100:00100000:3.0:1788832049.986241:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218326400 00000100:00100000:3.0:1788832049.986264:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788832049.986479:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+20:6522:x1875726218326400:12345-0@lo:101: 00010000:00010000:3.0:1788832049.986489:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832049.986500:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c421d2800/0x998c12b283536e27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536e20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832049.986521:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d2800/0x998c12b283536e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536e20 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832049.986531:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c421d2800/0x998c12b283536e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536e20 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832049.986540:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2800, rc 0) 00000100:00100000:3.0:1788832049.986646:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218326400:12345-0@lo:101: Request processed in 374us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832049.986652:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788832049.987052:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218326400:0@lo:101: 00010000:00010000:2.0:1788832049.987067:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2400/0x998c12b283536e20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536e27 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832049.987077:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2400/0x998c12b283536e20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536e27 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832049.987136:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218326528:0@lo:501: 00000100:00100000:2.0:1788832049.987165:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832049.987182:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788832049.987404:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788832049.987418:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218325888:12345-0@lo:400: 00000100:00100000:0.0:1788832049.987464:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218325888:12345-0@lo:400: Request processed in 52us (2935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832049.987471:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788832049.987530:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218325888:0@lo:400: 00010000:00080000:0.0:1788832049.987545:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b06611500 x1875726218325760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832049.987554:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218325760:0@lo:400: 00000100:00100000:0.0:1788832049.987787:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832049.987814:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218326016:0@lo:400: 00000100:00100000:0.0:1788832049.987841:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832049.987930:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218325504 00000100:00100000:2.0:1788832049.987936:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218325504 00000100:00100000:1.0:1788832049.987957:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788832049.987972:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218326016 00000100:00100000:2.0:1788832049.987975:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218326016 00000100:00100000:2.0:1788832049.987995:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788832049.988001:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218325504:12345-0@lo:400: 00000100:00100000:2.0:1788832049.988042:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218325504:12345-0@lo:400: Request processed in 41us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832049.988050:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788832049.988055:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788832049.988057:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218326016:12345-0@lo:400: 00000100:00100000:0.0:1788832049.988354:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218326016:12345-0@lo:400: Request processed in 108us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832049.988361:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788832049.988493:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b06610e00 x1875726218325504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832049.988505:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218325504:0@lo:400: 00010000:00080000:1.0:1788832049.988515:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b06610a80 x1875726218326016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832049.988524:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218326016:0@lo:400: 00000100:00100000:2.0:1788832049.989906:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218326528 00000100:00100000:2.0:1788832049.989918:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218326528 00000100:00100000:2.0:1788832049.989976:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788832049.989985:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218326528:12345-0@lo:501: 00000100:00100000:2.0:1788832049.990108:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218326528:12345-0@lo:501: Request processed in 124us (2942us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788832049.990116:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788832049.990196:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe25f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218326528:0@lo:501: 10000000:01000000:1.0:1788832049.990235:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788832049.990245:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2400/0x998c12b283536e20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536e27 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832049.990255:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2400/0x998c12b283536e20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536e27 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788832049.991614:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788832049.992389:0:8915:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788832049.992417:0:8915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8915:1875726218326784:0@lo:7: 00000100:00100000:1.0:1788832049.992482:0:8915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832049.992513:0:8915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832049.992539:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218326784 00000100:00100000:1.0:1788832049.992547:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218326784 00000100:00100000:1.0:1788832049.992606:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788832049.992615:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8915:x1875726218326784:12345-0@lo:7: 00000100:00100000:3.0:1788832049.993446:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832049.993464:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218326656:0@lo:13: 00000100:00100000:3.0:1788832049.993510:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832049.993649:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218326656 00000100:00100000:2.0:1788832049.993654:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218326656 00000100:00100000:2.0:1788832049.993688:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788832049.993696:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875726218326656:12345-0@lo:13: 00002000:00000024:2.0:1788832049.993720:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923935232 avail 3692412928 00000100:00100000:2.0:1788832049.993777:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1875726218326656:12345-0@lo:13: Request processed in 74us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832049.993784:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788832049.993831:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fcb6300 x1875726218326656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832049.993851:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218326656:0@lo:13: 00002000:00080000:1.0:1788832049.998999:0:8442:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788832049.999009:0:8442:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788832049.999890:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8915:x1875726218326784:12345-0@lo:7: Request processed in 7269us (7400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832049.999912:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788832050.000028:0:8915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fcb4700 x1875726218326784/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788832065 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832050.000044:0:8915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8915:1875726218326784:0@lo:7: 00000004:00080000:0.0:1788832050.000068:0:8915:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788832050.000133:0:8915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e776d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8915:1875726218326912:0@lo:5: 00000100:00100000:0.0:1788832050.000186:0:8915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832050.000218:0:8915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36dd4300 going to sleep for 11 seconds 00000100:00100000:1.0:1788832050.000390:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218326912 00000100:00100000:1.0:1788832050.000396:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218326912 00000100:00100000:1.0:1788832050.000449:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788832050.000458:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8915:x1875726218326912:12345-0@lo:5: 00002000:00080000:1.0:1788832050.000484:0:8440:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1788832050.000521:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8915:x1875726218326912:12345-0@lo:5: Request processed in 65us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832050.000527:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788832050.001386:0:8915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3e776d80 x1875726218326912/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788832065 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832050.001399:0:8915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e776d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8915:1875726218326912:0@lo:5: 00000004:00080000:0.0:1788832050.001410:0:8915:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788832050.001448:0:8915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e776d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8915:1875726218327040:0@lo:5: 00000100:00100000:0.0:1788832050.001484:0:8915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832050.001511:0:8915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36dd4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788832050.001527:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218327040 00000100:00100000:0.0:1788832050.001531:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218327040 00000100:00100000:0.0:1788832050.001580:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788832050.001588:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8915:x1875726218327040:12345-0@lo:5: 00002000:00080000:0.0:1788832050.001641:0:8442:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788832050.004422:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8915:x1875726218327040:12345-0@lo:5: Request processed in 2829us (2931us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788832050.004434:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1788832050.004644:0:8919:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788832050.004669:0:8919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe25180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8919:1875726218327296:0@lo:7: 00000100:00100000:2.0:1788832050.004712:0:8919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832050.004753:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218327296 00000100:00100000:2.0:1788832050.004761:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218327296 00000100:00100000:2.0:1788832050.004833:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788832050.004852:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8919:x1875726218327296:12345-0@lo:7: 00000100:00100000:3.0:1788832050.006201:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788832050.006224:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218327168:0@lo:13: 00000100:00100000:3.0:1788832050.006281:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832050.006333:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218327168 00000100:00100000:3.0:1788832050.006339:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218327168 00000100:00100000:3.0:1788832050.006386:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788832050.006395:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1875726218327168:12345-0@lo:13: 00002000:00000024:3.0:1788832050.006424:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:3.0:1788832050.006471:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1875726218327168:12345-0@lo:13: Request processed in 77us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832050.006478:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788832050.006521:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c1fe25880 x1875726218327168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832050.006541:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218327168:0@lo:13: 00010000:00080000:1.0:1788832050.006609:0:8915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3e776d80 x1875726218327040/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788832065 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832050.006634:0:8915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e776d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8915:1875726218327040:0@lo:5: 00000004:00080000:1.0:1788832050.006647:0:8915:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1788832050.006682:0:8915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8915:1875726218327424:0@lo:900: 00000100:00100000:1.0:1788832050.006711:0:8915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832050.006732:0:8915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832050.006742:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218327424 00000100:00100000:3.0:1788832050.006746:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218327424 00000100:00100000:3.0:1788832050.006783:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788832050.006792:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8915:x1875726218327424:12345-0@lo:900: 00000100:00080000:1.0:1788832050.006822:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788832050.006833:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8915:x1875726218327424:12345-0@lo:900: Request processed in 42us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832050.006839:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788832050.006846:0:8915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fcb5880 x1875726218327424/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788832066 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832050.006855:0:8915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8915:1875726218327424:0@lo:900: 00000100:00100000:0.0:1788832050.007782:0:8919:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b4480 going to sleep for 11 seconds 00002000:00080000:2.0:1788832050.011220:0:8440:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788832050.011229:0:8440:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788832050.011502:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8919:x1875726218327296:12345-0@lo:7: Request processed in 6646us (6784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832050.011513:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788832050.011616:0:8919:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c1fe25180 x1875726218327296/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788832066 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832050.011666:0:8919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe25180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8919:1875726218327296:0@lo:7: 00000004:00080000:0.0:1788832050.011681:0:8919:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788832050.011721:0:8919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8919:1875726218327552:0@lo:5: 00000100:00100000:0.0:1788832050.011953:0:8919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832050.012011:0:8919:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36dd4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788832050.012044:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218327552 00000100:00100000:1.0:1788832050.012051:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218327552 00000100:00100000:1.0:1788832050.012126:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788832050.012136:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8919:x1875726218327552:12345-0@lo:5: 00002000:00080000:1.0:1788832050.012163:0:8442:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788832050.012174:0:8442:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1788832050.020373:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:3.0:1788832050.020391:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788832050.020402:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788832050.020899:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8919:x1875726218327552:12345-0@lo:5: Request processed in 8761us (8941us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788832050.020910:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788832050.021027:0:8919:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3e774000 x1875726218327552/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788832066 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832050.021039:0:8919:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788832050.021045:0:8919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8919:1875726218327552:0@lo:5: 00000004:00080000:0.0:1788832050.021061:0:8919:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788832050.021173:0:8919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8919:1875726218327680:0@lo:700: 00000100:00100000:0.0:1788832050.021206:0:8919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832050.021276:0:8919:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36dd4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832050.021324:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218327680 00000100:00100000:3.0:1788832050.021330:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218327680 00000100:00100000:3.0:1788832050.021453:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788832050.021463:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8919:x1875726218327680:12345-0@lo:700: 00000100:00100000:3.0:1788832050.032526:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8919:x1875726218327680:12345-0@lo:700: Request processed in 11053us (11308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832050.032543:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788832050.032671:0:8919:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3e774000 x1875726218327680/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788832066 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832050.032687:0:8919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8919:1875726218327680:0@lo:700: 00000004:02000040:0.0:1788832050.035529:0:8919:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1788832050.043173:0:8919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8919:1875726218327808:0@lo:5: 00000100:00100000:1.0:1788832050.043250:0:8919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832050.043327:0:8919:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788832050.043345:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218327808 00000100:00100000:2.0:1788832050.043354:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218327808 00000100:00100000:2.0:1788832050.043413:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788832050.043423:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8919:x1875726218327808:12345-0@lo:5: 00002000:00080000:3.0:1788832050.056226:0:8440:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788832050.056249:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1788832050.059664:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8919:x1875726218327808:12345-0@lo:5: Request processed in 16198us (16370us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788832050.059690:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788832050.059971:0:8919:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fcb5880 x1875726218327808/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788832066 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832050.059992:0:8919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8919:1875726218327808:0@lo:5: 00000004:00080000:1.0:1788832050.060008:0:8919:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000001:00080000:3.0:1788832050.616894:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1788832050.654658:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788832051.437177:0:8969:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788832051.437403:0:8969:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788832051.672048:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788832052.227809:0:9018:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788832052.227819:0:9018:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1788832052.697188:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832052.952766:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218327936:0@lo:41: 00000100:00100000:0.0:1788832052.952864:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832052.952963:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218327936 00000100:00100000:1.0:1788832052.952971:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218327936 00000100:00100000:1.0:1788832052.955298:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788832052.955320:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218327936:12345-0@lo:41: 00000004:00000024:1.0:1788832052.955359:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788832052.955437:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218327936:12345-0@lo:41: Request processed in 126us (2572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832052.955444:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788832052.959693:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218327936:0@lo:41: 00000100:00100000:1.0:1788832053.463102:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788832053.463129:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218328064:0@lo:41: 00000100:00100000:1.0:1788832053.463199:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832053.463400:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218328064 00000100:00100000:3.0:1788832053.463410:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218328064 00000100:00100000:3.0:1788832053.463497:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788832053.463506:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218328064:12345-0@lo:41: 00000004:00000024:3.0:1788832053.463539:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788832053.463591:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218328064:12345-0@lo:41: Request processed in 86us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832053.463598:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788832053.463668:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218328064:0@lo:41: 00010000:00010000:0.0:1788832053.719689:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832054.742965:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832055.001032:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218328192:0@lo:13: 00000100:00100000:2.0:1788832055.001091:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832055.001353:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218328192 00000100:00100000:2.0:1788832055.001361:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218328192 00000100:00100000:1.0:1788832055.001428:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218328576:0@lo:400: 00000100:00100000:2.0:1788832055.001429:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788832055.001487:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832055.001510:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218329088:0@lo:400: 00000100:00100000:1.0:1788832055.001544:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832055.001579:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788832055.001585:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218328704:0@lo:400: 00000100:00100000:1.0:1788832055.001607:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832055.001647:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218329216:0@lo:400: 00000100:00100000:1.0:1788832055.001671:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832055.001698:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218328576 00000100:00100000:1.0:1788832055.001702:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218328576 00000100:00100000:1.0:1788832055.001732:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788832055.001751:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218328576:12345-0@lo:400: 00000100:00100000:1.0:1788832055.001805:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218328576:12345-0@lo:400: Request processed in 55us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832055.001812:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788832055.001832:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218329216 00000100:00100000:1.0:1788832055.001836:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218329216 00000100:00100000:1.0:1788832055.001863:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788832055.001871:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218329216:12345-0@lo:400: 00000100:00100000:2.0:1788832055.001897:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218328192:12345-0@lo:13: 00000100:00100000:1.0:1788832055.001907:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218329216:12345-0@lo:400: Request processed in 36us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832055.001914:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00000024:2.0:1788832055.001925:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1788832055.001954:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fcb6300 x1875726218329216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832055.001967:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218328192:12345-0@lo:13: Request processed in 525us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832055.001969:0:3651:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788832055.001980:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788832055.001989:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218329216:0@lo:400: 00000100:00100000:1.0:1788832055.002004:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218328576:0@lo:400: 00000100:00100000:2.0:1788832055.002009:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218328320:0@lo:400: 00000100:00100000:2.0:1788832055.002046:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832055.002062:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875726218328448:0@lo:400: 00000100:00100000:2.0:1788832055.002080:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218328832:0@lo:400: 00000100:00100000:1.0:1788832055.002102:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832055.002118:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832055.002131:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218328960:0@lo:400: 00000100:00100000:1.0:1788832055.002160:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788832055.002173:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832055.002196:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218329088 00000100:00100000:2.0:1788832055.002200:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218329088 00000100:00100000:1.0:1788832055.002205:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218328704 00000100:00100000:1.0:1788832055.002211:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218328704 00000100:00100000:2.0:1788832055.002237:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218328448 00000100:00100000:1.0:1788832055.002239:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218328960 00000100:00100000:2.0:1788832055.002242:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218328448 00000100:00100000:1.0:1788832055.002244:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218328960 00000100:00100000:2.0:1788832055.002270:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788832055.002277:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788832055.002282:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218329088:12345-0@lo:400: 00000100:00100000:1.0:1788832055.002289:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218328704:12345-0@lo:400: 00000100:00100000:2.0:1788832055.002338:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218329088:12345-0@lo:400: Request processed in 61us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832055.002345:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788832055.002361:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788832055.002369:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875726218328448:12345-0@lo:400: 00000100:00100000:2.0:1788832055.002408:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875726218328448:12345-0@lo:400: Request processed in 40us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832055.002414:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788832055.002432:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788832055.002440:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218328960:12345-0@lo:400: 00000100:00100000:3.0:1788832055.002457:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218328320 00000100:00100000:3.0:1788832055.002461:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218328320 00000100:00100000:3.0:1788832055.002541:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788832055.002546:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+21:3653:x1875726218328320:12345-0@lo:400: 00000100:00100000:3.0:1788832055.002577:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+21:3653:x1875726218328320:12345-0@lo:400: Request processed in 31us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832055.002581:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788832055.002707:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218328960:12345-0@lo:400: Request processed in 268us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832055.002714:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788832055.002746:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218328832 00000100:00100000:2.0:1788832055.002751:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218328832 00000100:00100000:2.0:1788832055.002777:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788832055.002782:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218328832:12345-0@lo:400: 00000100:00100000:1.0:1788832055.002853:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218328704:12345-0@lo:400: Request processed in 566us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832055.002860:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788832055.002905:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218328832:12345-0@lo:400: Request processed in 121us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832055.002912:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788832055.002940:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788832055.002950:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788832055.002976:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218328320:0@lo:400: 00000100:00100000:2.0:1788832055.002989:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218328832:0@lo:400: 00010000:00080000:2.0:1788832055.003032:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fcb4000 x1875726218328448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832055.003044:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875726218328448:0@lo:400: 00010000:00080000:2.0:1788832055.003061:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fcb5c00 x1875726218328960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832055.003071:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218328960:0@lo:400: 00010000:00080000:2.0:1788832055.003102:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fcb6680 x1875726218328192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832055.003110:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788832055.003126:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218328192:0@lo:13: 00010000:00080000:2.0:1788832055.003153:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fcb7b80 x1875726218328704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832055.003162:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218328704:0@lo:400: 00010000:00080000:2.0:1788832055.003177:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fcb4700 x1875726218329088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832055.003185:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218329088:0@lo:400: 00000100:00100000:2.0:1788832055.518780:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218329344:0@lo:13: 00000100:00100000:2.0:1788832055.518853:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832055.518935:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218329344 00000100:00100000:2.0:1788832055.518943:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218329344 00000100:00100000:2.0:1788832055.519002:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788832055.519010:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218329344:12345-0@lo:13: 00002000:00000024:2.0:1788832055.519034:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788832055.519075:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218329344:12345-0@lo:13: Request processed in 65us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832055.519082:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788832055.519117:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fcb9500 x1875726218329344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832055.519136:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218329344:0@lo:13: 00010000:00010000:2.0:1788832055.766909:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832056.790968:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832057.818449:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832058.079262:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832058.079288:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218329472:0@lo:41: 00000100:00100000:2.0:1788832058.079357:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832058.079481:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218329472 00000100:00100000:3.0:1788832058.079489:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218329472 00000100:00100000:3.0:1788832058.079571:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788832058.079582:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218329472:12345-0@lo:41: 00000004:00000024:3.0:1788832058.079615:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788832058.079748:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218329472:12345-0@lo:41: Request processed in 168us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832058.079763:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788832058.080094:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218329472:0@lo:41: 00000100:00100000:1.0:1788832058.582918:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218329600:0@lo:41: 00000100:00100000:1.0:1788832058.583001:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832058.583074:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218329600 00000100:00100000:1.0:1788832058.583082:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218329600 00000100:00100000:1.0:1788832058.583124:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788832058.583133:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218329600:12345-0@lo:41: 00000004:00000024:1.0:1788832058.583841:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788832058.583900:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218329600:12345-0@lo:41: Request processed in 765us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832058.583908:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788832058.583960:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218329600:0@lo:41: 00010000:00010000:2.0:1788832058.839331:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832059.866775:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832060.118929:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218329728:0@lo:400: 00000100:00100000:0.0:1788832060.119016:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832060.121471:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788832060.121497:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218330112:0@lo:400: 00000100:00100000:0.0:1788832060.121571:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832060.121670:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218329728 00000100:00100000:0.0:1788832060.122004:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218329728 00000100:00100000:0.0:1788832060.122065:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788832060.122076:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+21:3652:x1875726218329728:12345-0@lo:400: 00000100:00100000:0.0:1788832060.122137:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+21:3652:x1875726218329728:12345-0@lo:400: Request processed in 64us (3121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832060.122144:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788832060.122176:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218329856:0@lo:400: 00000100:00100000:0.0:1788832060.122200:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832060.122220:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788832060.122226:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218329984:0@lo:400: 00000100:00100000:0.0:1788832060.122249:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832060.122275:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218330112 00000100:00100000:0.0:1788832060.122279:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218330112 00000100:00100000:0.0:1788832060.122800:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218329856 00000100:00100000:0.0:1788832060.122806:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218329856 00000100:00100000:2.0:1788832060.123273:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218329984 00000100:00100000:2.0:1788832060.123278:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218329984 00000100:00100000:2.0:1788832060.123326:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788832060.123336:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218329984:12345-0@lo:400: 00000100:00100000:2.0:1788832060.123401:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218329984:12345-0@lo:400: Request processed in 67us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832060.123409:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788832060.123456:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788832060.123465:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218330112:12345-0@lo:400: 00000100:00100000:0.0:1788832060.123501:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218330112:12345-0@lo:400: Request processed in 38us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832060.123507:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788832060.123519:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788832060.123525:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218329856:12345-0@lo:400: 00000100:00100000:0.0:1788832060.123551:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218329856:12345-0@lo:400: Request processed in 27us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832060.123557:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788832060.123868:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fcbb800 x1875726218330112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832060.123883:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218330112:0@lo:400: 00000100:00100000:2.0:1788832060.123908:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218329728:0@lo:400: 00000100:00100000:2.0:1788832060.124032:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832060.124045:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218330240:0@lo:13: 00000100:00100000:2.0:1788832060.124084:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832060.124114:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218330240 00000100:00100000:2.0:1788832060.124118:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218330240 00000100:00100000:2.0:1788832060.124153:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788832060.124161:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218330240:12345-0@lo:13: 00002000:00000024:2.0:1788832060.124185:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788832060.124221:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218330240:12345-0@lo:13: Request processed in 61us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832060.124227:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788832060.124244:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788832060.124264:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c1fe24a80 x1875726218330240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832060.124278:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218330240:0@lo:13: 00000100:00100000:0.0:1788832060.125440:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218329984:0@lo:400: 00010000:00080000:0.0:1788832060.125466:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fcb9c00 x1875726218329856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832060.125477:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218329856:0@lo:400: 00000100:00100000:0.0:1788832060.125549:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788832060.125559:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218330368:0@lo:400: 00000100:00100000:0.0:1788832060.125601:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832060.125662:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218330496:0@lo:400: 00000100:00100000:0.0:1788832060.125685:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832060.125740:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218330624:0@lo:400: 00000100:00100000:0.0:1788832060.125766:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832060.125794:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218330496 00000100:00100000:0.0:1788832060.125799:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218330496 00000100:00100000:0.0:1788832060.125837:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218330624 00000100:00100000:0.0:1788832060.125841:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218330624 00000100:00100000:0.0:1788832060.125856:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788832060.125864:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218330496:12345-0@lo:400: 00000100:00100000:0.0:1788832060.125906:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218330496:12345-0@lo:400: Request processed in 42us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832060.125913:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788832060.125928:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788832060.125935:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218330624:12345-0@lo:400: 00000100:00100000:0.0:1788832060.125964:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218330624:12345-0@lo:400: Request processed in 31us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832060.125969:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1788832060.125993:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3e777800 x1875726218330496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832060.126014:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e777800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218330496:0@lo:400: 00000100:00080000:0.0:1788832060.126032:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788832060.126036:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788832060.126050:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3e775880 x1875726218330624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832060.126057:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218330624:0@lo:400: 00000100:00100000:0.0:1788832060.126084:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788832060.126090:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218330752:0@lo:400: 00000100:00100000:0.0:1788832060.126112:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832060.126146:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218330368 00000100:00100000:0.0:1788832060.126149:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218330368 00000100:00100000:0.0:1788832060.126170:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788832060.126176:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218330368:12345-0@lo:400: 00000100:00100000:0.0:1788832060.126206:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218330368:12345-0@lo:400: Request processed in 30us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832060.126211:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788832060.126230:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218330368:0@lo:400: 00000100:00100000:3.0:1788832060.128045:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218330752 00000100:00100000:3.0:1788832060.128057:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218330752 00000100:00100000:3.0:1788832060.128123:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788832060.128133:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218330752:12345-0@lo:400: 00000100:00100000:3.0:1788832060.128229:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218330752:12345-0@lo:400: Request processed in 97us (2114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832060.128235:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788832060.128282:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b06610e00 x1875726218330752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832060.128294:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218330752:0@lo:400: 00000100:00080000:0.0:1788832060.129583:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:1.0:1788832060.275324:0:9517:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788832060.275329:0:9517:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788832060.275330:0:9517:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788832060.275469:0:9517:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d2c3fcaa000 00000020:01000004:1.0:1788832060.275485:0:9517:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788832060.275504:0:9517:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788832060.275519:0:9517:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9d2c18ec99b8) 00000020:00000080:1.0:1788832060.275537:0:9517:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788832060.318107:0:9517:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788832060.318176:0:9517:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1788832060.341169:0:9517:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788832060.341581:0:9517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788832060.341594:0:9517:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788832060.341604:0:9517:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x998c12b283536e35 00000020:01000004:0.0:1788832060.341611:0:9517:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788832060.341743:0:9517:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.126@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788832060.341747:0:9517:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788832060.341753:0:9517:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788832060.341786:0:9517:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788832060.341791:0:9517:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788832060.360099:0:9517:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788832060.360143:0:9517:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.126@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788832060.360147:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788832060.360148:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788832060.360150:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832060.360151:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832060.360152:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832060.360153:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832060.360154:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788832060.360156:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788832060.360157:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788832060.360159:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832060.360160:0:9517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788832060.360163:0:9517:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788832060.360166:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788832060.360167:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788832060.360168:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832060.360169:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832060.360170:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832060.360171:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832060.360172:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788832060.360173:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788832060.360174:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788832060.360175:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832060.360176:0:9517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788832060.360202:0:9517:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788832060.360221:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06610700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218330880:0@lo:253: 00000100:00100000:0.0:1788832060.360294:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832060.360547:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0531c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788832060.360777:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218330880 00000100:00100000:3.0:1788832060.360785:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218330880 00000100:00100000:3.0:1788832060.360865:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788832060.360874:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+21:9517:x1875726218330880:12345-0@lo:253: 20000000:01000000:3.0:1788832060.360904:0:6517:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788832060.360908:0:6517:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788832060.360913:0:6517:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788832060.360916:0:6517:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788832060.361121:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788832060.361279:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1788832060.361293:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788832060.361323:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1788832060.361329:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788832060.361409:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1788832060.361427:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1788832060.361759:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1788832060.361777:0:6517:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.126@tcp 20000000:01000000:3.0:1788832060.361785:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:3.0:1788832060.361803:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1788832060.361810:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788832060.361824:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1788832060.361830:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:3.0:1788832060.361843:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1788832060.361849:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788832060.361862:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1788832060.361876:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1788832060.361951:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1788832060.361961:0:6517:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.126@tcp 20000000:01000000:3.0:1788832060.361963:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:3.0:1788832060.361976:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1788832060.361982:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788832060.361996:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1788832060.362000:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:3.0:1788832060.362011:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1788832060.362016:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788832060.362026:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1788832060.362040:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1788832060.366380:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1788832060.366412:0:6517:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.126@tcp 20000000:01000000:3.0:1788832060.366414:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.126@tcp (null) (null) (null) 00000040:00080000:3.0:1788832060.366431:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1788832060.366438:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788832060.366451:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1788832060.366457:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.126@tcp (null) (null) 00000040:00080000:3.0:1788832060.366469:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1788832060.366476:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788832060.366489:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1788832060.369019:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1788832060.369059:0:6517:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788832060.369062:0:6517:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788832060.369066:0:6517:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788832060.369115:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788832060.369118:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788832060.371229:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1788832060.371282:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1788832060.371294:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788832060.372461:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788832060.372495:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1788832060.372511:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1788832060.372539:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788832060.372542:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788832060.375960:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1788832060.376011:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1788832060.376028:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1788832060.376254:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1788832060.376279:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1788832060.376292:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1788832060.376303:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788832060.376306:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788832060.376747:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1788832060.376932:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1788832060.376954:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1788832060.376969:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1788832060.376979:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788832060.376981:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788832060.379234:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1788832060.379285:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1788832060.379312:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1788832060.379432:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1788832060.379453:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1788832060.379467:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1788832060.379490:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788832060.379493:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788832060.379912:0:9527:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1788832060.379935:0:9527:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1788832060.379949:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1788832060.380014:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1788832060.380029:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1788832060.380039:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:3.0:1788832060.380053:0:6517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788832060.380072:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e3c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.380090:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c390f3800/0x998c12b283536d32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536d2b expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.380098:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c421d2c00/0x998c12b283536d5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536d55 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.380117:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c00030600/0x998c12b283536d9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536d94 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.380124:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c00030c00/0x998c12b283536db7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536db0 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.380132:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c390f3e00/0x998c12b283536de1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536dda expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.380138:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c390f3a00/0x998c12b283536dfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536df6 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.380144:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c421d2800/0x998c12b283536e27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536e20 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.380152:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e3c lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.380189:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c421d2800/0x998c12b283536e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536e20 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.380204:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c421d2800/0x998c12b283536e27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536e20 expref: 21 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832060.380220:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218331008:0@lo:104: 00000100:00100000:3.0:1788832060.380295:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832060.380340:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218331008 00000100:00100000:0.0:1788832060.380347:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218331008 00010000:00010000:3.0:1788832060.380353:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c390f3a00/0x998c12b283536dfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536df6 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.380361:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c390f3a00/0x998c12b283536dfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536df6 expref: 21 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832060.380376:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218331136:0@lo:104: 00000100:00100000:0.0:1788832060.380385:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788832060.380393:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+3:6517:x1875726218331008:12345-0@lo:104: 00000100:00100000:3.0:1788832060.380398:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788832060.380413:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c390f3e00/0x998c12b283536de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536dda expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.380413:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2400/0x998c12b283536e20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536e27 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.380422:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c390f3e00/0x998c12b283536de1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536dda expref: 21 pid: 6519 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832060.380429:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218331264:0@lo:104: 00000100:00100000:3.0:1788832060.380446:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788832060.380460:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c00030c00/0x998c12b283536db7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536db0 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.380467:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1788832060.380468:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c00030c00/0x998c12b283536db7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536db0 expref: 21 pid: 6517 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832060.380472:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+3:6517:x1875726218331008:12345-0@lo:104: Request processed in 80us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832060.380476:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218331392:0@lo:104: 00000100:00100000:0.0:1788832060.380480:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788832060.380493:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832060.380496:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218331136 00000100:00100000:0.0:1788832060.380498:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218331136 00000100:00100000:0.0:1788832060.380509:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218331264 00000100:00100000:0.0:1788832060.380511:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218331264 00010000:00010000:3.0:1788832060.380516:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c00030600/0x998c12b283536d9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536d94 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832060.380519:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218331392 00000100:00100000:0.0:1788832060.380521:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218331392 00010000:00010000:3.0:1788832060.380525:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c00030600/0x998c12b283536d9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536d94 expref: 21 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832060.380531:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788832060.380533:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218331520:0@lo:104: 00000100:00100000:0.0:1788832060.380535:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+5:6517:x1875726218331136:12345-0@lo:104: 00010000:00010000:0.0:1788832060.380542:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8800/0x998c12b283536df6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536dfd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832060.380552:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788832060.380567:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c421d2c00/0x998c12b283536d5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536d55 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.380568:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788832060.380573:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+5:6517:x1875726218331136:12345-0@lo:104: Request processed in 38us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832060.380579:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1788832060.380585:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c421d2c00/0x998c12b283536d5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536d55 expref: 21 pid: 6519 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832060.380589:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218331520 00000100:00100000:0.0:1788832060.380591:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218331520 00000100:00100000:3.0:1788832060.380593:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218331648:0@lo:104: 00000100:00100000:0.0:1788832060.380603:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788832060.380608:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+5:6517:x1875726218331264:12345-0@lo:104: 00010000:00010000:0.0:1788832060.380614:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3600/0x998c12b283536dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536de1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832060.380650:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832060.380674:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788832060.380679:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+5:6517:x1875726218331264:12345-0@lo:104: Request processed in 71us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832060.380685:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1788832060.380686:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c390f3800/0x998c12b283536d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536d2b expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.380694:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c390f3800/0x998c12b283536d32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536d2b expref: 21 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832060.380713:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788832060.380714:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218331776:0@lo:104: 00000100:00100000:0.0:1788832060.380721:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218331648 00000100:00100000:0.0:1788832060.380724:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218331648 00000100:00100000:3.0:1788832060.380733:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832060.380736:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218331776 00000100:00100000:0.0:1788832060.380738:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218331776 00000100:00100000:3.0:1788832060.380745:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3483f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788832060.380748:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788832060.380753:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+6:6517:x1875726218331392:12345-0@lo:104: 00010000:00010000:0.0:1788832060.380759:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283536db0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536db7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832060.380768:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218331008:0@lo:104: 00000100:00100000:3.0:1788832060.380777:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218331136:0@lo:104: 00010000:00010000:0.0:1788832060.380782:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788832060.380783:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218331264:0@lo:104: 00000100:00100000:0.0:1788832060.380786:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+6:6517:x1875726218331392:12345-0@lo:104: Request processed in 33us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832060.380789:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218331392:0@lo:104: 00000100:00100000:0.0:1788832060.380793:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788832060.380803:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788832060.380808:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+5:6517:x1875726218331520:12345-0@lo:104: 00010000:00010000:0.0:1788832060.380814:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536d94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536d9b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.380841:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788832060.380846:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+5:6517:x1875726218331520:12345-0@lo:104: Request processed in 38us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832060.380847:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218331520:0@lo:104: 00000100:00100000:0.0:1788832060.380851:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788832060.380869:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788832060.380875:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b016f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+4:6517:x1875726218331648:12345-0@lo:104: 00010000:00010000:0.0:1788832060.380883:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b283536d55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536d5c expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.380920:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788832060.380925:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b016f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+4:6517:x1875726218331648:12345-0@lo:104: Request processed in 51us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832060.380930:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788832060.380954:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788832060.380959:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+3:6517:x1875726218331776:12345-0@lo:104: 00010000:00010000:0.0:1788832060.380966:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536d2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536d32 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.380990:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788832060.380994:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+3:6517:x1875726218331776:12345-0@lo:104: Request processed in 36us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832060.381000:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788832060.382854:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788832060.382867:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2400/0x998c12b283536e20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536e27 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.382888:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2400 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832060.382892:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2400/0x998c12b283536e20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536e27 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.382903:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2400/0x998c12b283536e20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536e27 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832060.382909:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2400/0x998c12b283536e20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536e27 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832060.382915:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832060.382968:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2400/0x998c12b283536e20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536e27 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.382975:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832060.382994:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2400/0x998c12b283536e20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536e27 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383000:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2400/0x998c12b283536e20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536e27 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383014:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788832060.383018:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8800/0x998c12b283536df6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536dfd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383023:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c36db8800 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832060.383026:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8800/0x998c12b283536df6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536dfd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383058:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8800/0x998c12b283536df6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536dfd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832060.383065:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8800/0x998c12b283536df6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536dfd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832060.383070:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832060.383083:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8800/0x998c12b283536df6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536dfd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383089:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832060.383094:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8800/0x998c12b283536df6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536dfd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383101:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8800/0x998c12b283536df6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536dfd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383111:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788832060.383115:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3600/0x998c12b283536dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536de1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383120:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c390f3600 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832060.383122:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3600/0x998c12b283536dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536de1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383128:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3600/0x998c12b283536dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536de1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832060.383133:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3600/0x998c12b283536dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536de1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832060.383143:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832060.383155:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3600/0x998c12b283536dda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536de1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383161:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832060.383172:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3600/0x998c12b283536dda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536de1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383178:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3600/0x998c12b283536dda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536de1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383188:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788832060.383191:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283536db0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536db7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383196:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2200 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832060.383198:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283536db0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536db7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383204:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283536db0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536db7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832060.383211:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283536db0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536db7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832060.383216:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832060.383227:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283536db0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536db7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383233:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832060.383244:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283536db0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536db7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383250:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283536db0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536db7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383259:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788832060.383262:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536d94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536d9b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383268:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c390f2200 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832060.383270:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536d94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536d9b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383276:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536d94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536d9b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832060.383281:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536d94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536d9b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832060.383285:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832060.383375:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536d94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536d9b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383382:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832060.383387:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536d94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536d9b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383392:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536d94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536d9b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383403:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788832060.383410:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b283536d55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536d5c expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383416:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031e00 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832060.383419:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b283536d55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536d5c expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383425:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b283536d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536d5c expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832060.383431:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b283536d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536d5c expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832060.383436:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832060.383450:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b283536d55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536d5c expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383456:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832060.383460:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b283536d55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536d5c expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383467:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b283536d55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536d5c expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383530:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832060.383534:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536d2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536d32 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383541:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c390f3c00 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832060.383544:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536d2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536d32 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383562:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536d2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536d32 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832060.383570:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536d2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536d32 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832060.383575:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832060.383589:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536d2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536d32 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383595:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832060.383599:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536d2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536d32 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383606:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536d2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536d32 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.383650:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832060.383652:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832060.383654:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832060.383661:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832060.383677:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218332032:0@lo:103: 00000100:00100000:2.0:1788832060.383745:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832060.383785:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218332544:0@lo:103: 00000100:00100000:2.0:1788832060.383819:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832060.383841:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788832060.383847:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218331904:0@lo:103: 00000100:00100000:2.0:1788832060.383866:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832060.383890:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218332416:0@lo:103: 00000100:00100000:2.0:1788832060.383911:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832060.384003:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218332288:0@lo:103: 00000100:00100000:2.0:1788832060.384028:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832060.384042:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788832060.384047:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218332160:0@lo:103: 00000100:00100000:2.0:1788832060.384064:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832060.384072:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218332672:0@lo:103: 00000100:00100000:2.0:1788832060.384088:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832060.384109:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218332032 00000100:00100000:2.0:1788832060.384115:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218332032 00010000:00010000:2.0:1788832060.384143:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c390f3a00/0x998c12b283536dfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536df6 expref: 22 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832060.384162:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218332544 00000100:00100000:2.0:1788832060.384165:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218332544 00010000:00010000:2.0:1788832060.384174:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c421d2c00/0x998c12b283536d5c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536d55 expref: 23 pid: 6519 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832060.384183:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218331904 00000100:00100000:2.0:1788832060.384185:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218331904 00010000:00010000:2.0:1788832060.384193:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c421d2800/0x998c12b283536e27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536e20 expref: 24 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832060.384202:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218332416 00000100:00100000:2.0:1788832060.384204:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218332416 00010000:00010000:2.0:1788832060.384226:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c00030600/0x998c12b283536d9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536d94 expref: 25 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832060.384238:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218332288 00000100:00100000:2.0:1788832060.384246:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218332288 00010000:00010000:2.0:1788832060.384257:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c00030c00/0x998c12b283536db7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536db0 expref: 26 pid: 6517 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832060.384268:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218332160 00000100:00100000:2.0:1788832060.384270:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218332160 00010000:00010000:2.0:1788832060.384279:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c390f3e00/0x998c12b283536de1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536dda expref: 27 pid: 6519 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832060.384287:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218332672 00000100:00100000:2.0:1788832060.384289:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218332672 00000100:00100000:3.0:1788832060.384306:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788832060.384318:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+28:3654:x1875726218332032:12345-0@lo:103: 00010000:00010000:3.0:1788832060.384331:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832060.384337:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c390f3a00/0x998c12b283536dfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536df6 expref: 28 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.384365:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c390f3a00/0x998c12b283536dfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536df6 expref: 28 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.384380:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c390f3a00/0x998c12b283536dfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536df6 expref: 28 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.384392:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832060.384431:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+27:3654:x1875726218332032:12345-0@lo:103: Request processed in 116us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832060.384438:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788832060.384455:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788832060.384461:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+26:3654:x1875726218332544:12345-0@lo:103: 00010000:00010000:3.0:1788832060.384468:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832060.384472:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c421d2c00/0x998c12b283536d5c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536d55 expref: 26 pid: 6519 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.384480:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c421d2c00/0x998c12b283536d5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536d55 expref: 26 pid: 6519 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.384490:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832060.384510:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+26:3654:x1875726218332544:12345-0@lo:103: Request processed in 50us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832060.384529:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788832060.384543:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788832060.384548:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+25:3654:x1875726218331904:12345-0@lo:103: 00010000:00010000:3.0:1788832060.384555:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832060.384560:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c421d2800/0x998c12b283536e27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536e20 expref: 25 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.384573:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c421d2800/0x998c12b283536e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536e20 expref: 25 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.384584:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c421d2800/0x998c12b283536e27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536e20 expref: 25 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.384593:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832060.384615:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+24:3654:x1875726218331904:12345-0@lo:103: Request processed in 67us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832060.384671:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788832060.384683:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788832060.384689:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18e25c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+23:3654:x1875726218332416:12345-0@lo:103: 00010000:00010000:3.0:1788832060.384696:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832060.384710:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c00030600/0x998c12b283536d9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536d94 expref: 23 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.384717:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c00030600/0x998c12b283536d9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536d94 expref: 23 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.384727:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c00030600/0x998c12b283536d9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536d94 expref: 23 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.384735:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832060.384755:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18e25c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+22:3654:x1875726218332416:12345-0@lo:103: Request processed in 67us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832060.384760:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788832060.384788:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788832060.384793:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+21:3652:x1875726218332288:12345-0@lo:103: 00010000:00010000:3.0:1788832060.384803:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832060.384807:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c00030c00/0x998c12b283536db7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536db0 expref: 21 pid: 6517 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.384814:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c00030c00/0x998c12b283536db7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536db0 expref: 21 pid: 6517 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.384822:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c00030c00/0x998c12b283536db7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536db0 expref: 21 pid: 6517 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.384829:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832060.384851:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+20:3652:x1875726218332288:12345-0@lo:103: Request processed in 59us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832060.384857:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788832060.384867:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788832060.384872:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+19:3652:x1875726218332160:12345-0@lo:103: 00010000:00010000:3.0:1788832060.384877:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832060.384881:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c390f3e00/0x998c12b283536de1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536dda expref: 19 pid: 6519 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.384889:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c390f3e00/0x998c12b283536de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536dda expref: 19 pid: 6519 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.384898:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c390f3e00/0x998c12b283536de1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536dda expref: 19 pid: 6519 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.384905:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832060.384921:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+18:3652:x1875726218332160:12345-0@lo:103: Request processed in 50us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832060.384926:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788832060.384963:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218331904:0@lo:103: 00000100:00100000:3.0:1788832060.384971:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218332416:0@lo:103: 00000100:00100000:3.0:1788832060.384978:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218332032:0@lo:103: 00000100:00100000:3.0:1788832060.384984:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218332544:0@lo:103: 00000100:00100000:3.0:1788832060.385008:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218332160:0@lo:103: 00000100:00100000:3.0:1788832060.385014:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218332288:0@lo:103: 00010000:00010000:3.0:1788832060.385035:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c421d2c00/0x998c12b283536d5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536d55 expref: 17 pid: 6519 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832060.385044:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218331648:0@lo:104: 00000100:00100000:3.0:1788832060.385052:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6517:1875726218331776:0@lo:104: 00010000:00010000:3.0:1788832060.385075:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e3c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.385294:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c390f3800/0x998c12b283536d32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536d2b expref: 28 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832060.385337:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788832060.385345:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e55f0905-9d39-4464-9830-326b420fb582+16:3652:x1875726218332672:12345-0@lo:103: 00010000:00010000:2.0:1788832060.385353:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832060.385357:0:7466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c390f3800/0x998c12b283536d32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536d2b expref: 16 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.385367:0:7466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c390f3800/0x998c12b283536d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536d2b expref: 16 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.385377:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c390f3800/0x998c12b283536d32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536d2b expref: 16 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.385388:0:7466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e3c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.385396:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e3c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.385418:0:7466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e3c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.385425:0:7466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e3c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.385431:0:7466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e3c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.385436:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e3c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.385442:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d3e00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832060.385446:0:7466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e3c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.385452:0:7466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e3c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.385462:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e3c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.385470:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832060.385511:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e55f0905-9d39-4464-9830-326b420fb582+15:3652:x1875726218332672:12345-0@lo:103: Request processed in 168us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832060.385518:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788832060.386258:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218332672:0@lo:103: 00010000:00010000:3.0:1788832060.386280:0:6517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e3c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.386288:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e3c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.386295:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e3c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788832060.386307:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788832060.390874:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+14:9517:x1875726218330880:12345-0@lo:253: Request processed in 29994us (30572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832060.390888:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788832060.390980:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06610700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218330880:0@lo:253: 10000000:01000000:2.0:1788832060.390996:0:9517:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788832060.390998:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788832060.391009:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788832060.391010:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788832060.391011:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788832060.391012:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788832060.391013:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788832060.391014:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788832060.391014:0:9517:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788832060.391016:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788832060.391016:0:9517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788832060.391034:0:9517:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d2c3fcaa000 from lustre-OST0001 10000000:01000000:2.0:1788832060.391060:0:9517:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788832060.391062:0:9517:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788832060.391069:0:9517:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d2c18e319b8 local copy 10000000:01000000:2.0:1788832060.391072:0:9517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788832060.391104:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536e43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.391111:0:9517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536e43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.391118:0:9517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536e43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832060.391131:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218332800:0@lo:101: 00000100:00100000:2.0:1788832060.391157:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832060.391548:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032f60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832060.392914:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218332800 00000100:00100000:3.0:1788832060.392927:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218332800 00000100:00100000:3.0:1788832060.392989:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788832060.393000:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+14:9517:x1875726218332800:12345-0@lo:101: 00010000:00010000:3.0:1788832060.393015:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832060.393033:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c421d2800/0x998c12b283536e4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536e43 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.393059:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d2800/0x998c12b283536e4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536e43 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.393070:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c421d2800/0x998c12b283536e4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536e43 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.393078:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2800, rc 0) 00000100:00100000:3.0:1788832060.393195:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:9517:x1875726218332800:12345-0@lo:101: Request processed in 197us (2036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832060.393203:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788832060.393270:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218332800:0@lo:101: 00010000:00010000:2.0:1788832060.393287:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536e43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x998c12b283536e4a expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.393308:0:9517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536e43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x998c12b283536e4a expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832060.393432:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218332928:0@lo:501: 00000100:00100000:2.0:1788832060.393463:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832060.393882:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032f60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832060.394035:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218332928 00000100:00100000:1.0:1788832060.394041:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218332928 00000100:00100000:1.0:1788832060.394105:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788832060.394113:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+15:9517:x1875726218332928:12345-0@lo:501: 00000100:00100000:1.0:1788832060.394187:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+15:9517:x1875726218332928:12345-0@lo:501: Request processed in 75us (723us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788832060.394194:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788832060.394256:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218332928:0@lo:501: 10000000:01000000:2.0:1788832060.394269:0:9517:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788832060.394289:0:9517:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788832060.394295:0:9517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536e43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x998c12b283536e4a expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.394303:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536e43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x998c12b283536e4a expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.394310:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536e43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x998c12b283536e4a expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.394338:0:9517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788832060.394361:0:9517:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d2c3fcaa000 10000000:01000000:2.0:1788832060.394366:0:9517:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788832060.394371:0:9517:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788832060.394374:0:9517:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788832060.394378:0:9517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788832060.394381:0:9517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788832060.394400:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd600/0x998c12b283536e51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.394407:0:9517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd600/0x998c12b283536e51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.394430:0:9517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd600/0x998c12b283536e51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832060.394443:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218333056:0@lo:101: 00000100:00100000:2.0:1788832060.394470:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832060.394496:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032f6600 going to sleep for 11 seconds 00010000:00010000:1.0:1788832060.394534:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832060.394541:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536e43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x998c12b283536e4a expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.394548:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc600 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:1.0:1788832060.394551:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536e43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x998c12b283536e4a expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.394569:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536e43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x998c12b283536e4a expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788832060.394575:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536e43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x998c12b283536e4a expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832060.394580:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788832060.394601:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536e43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x998c12b283536e4a expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.394607:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788832060.394651:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536e43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x998c12b283536e4a expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.394658:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283536e43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x998c12b283536e4a expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.394668:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832060.394670:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832060.394672:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832060.394680:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218333056 00000100:00100000:1.0:1788832060.394683:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218333056 00000100:00100000:1.0:1788832060.394713:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788832060.394720:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+15:9517:x1875726218333056:12345-0@lo:101: 00010000:00010000:1.0:1788832060.394727:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832060.394739:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c390f2a00/0x998c12b283536e58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536e51 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.394755:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c390f2a00/0x998c12b283536e58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536e51 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.394772:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c390f2a00/0x998c12b283536e58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536e51 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.394780:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c390f2a00, rc 0) 00000100:00100000:1.0:1788832060.394812:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+16:9517:x1875726218333056:12345-0@lo:101: Request processed in 93us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832060.394818:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788832060.394866:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218333056:0@lo:101: 00010000:00010000:1.0:1788832060.394877:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd600/0x998c12b283536e51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536e58 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.394885:0:9517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd600/0x998c12b283536e51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536e58 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832060.394946:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218333312:0@lo:501: 00000100:00100000:1.0:1788832060.394971:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832060.394991:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218333312 00000100:00100000:1.0:1788832060.394994:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218333312 00000100:00100000:1.0:1788832060.395011:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788832060.395016:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+16:9517:x1875726218333312:12345-0@lo:501: 00000100:00100000:1.0:1788832060.395097:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+16:9517:x1875726218333312:12345-0@lo:501: Request processed in 80us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832060.395103:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788832060.395122:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b063763c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832060.395133:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218333312:0@lo:501: 00000100:00100000:1.0:1788832060.395156:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218333440:0@lo:503: 00000100:00100000:3.0:1788832060.395357:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832060.395371:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218333184:0@lo:103: 00000100:00100000:3.0:1788832060.395406:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832060.395937:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218333184 00000100:00100000:0.0:1788832060.395945:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218333184 00000100:00100000:0.0:1788832060.396027:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788832060.396036:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+16:3651:x1875726218333184:12345-0@lo:103: 00010000:00010000:0.0:1788832060.396047:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832060.396063:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c421d2800/0x998c12b283536e4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x998c12b283536e43 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.396076:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832060.396123:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+15:3651:x1875726218333184:12345-0@lo:103: Request processed in 89us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832060.396130:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832060.396138:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788832060.396153:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218333440 00000100:00100000:2.0:1788832060.396196:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218333184:0@lo:103: 00000100:00100000:1.0:1788832060.396250:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218333440 00000100:00100000:1.0:1788832060.396285:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788832060.396291:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+15:9517:x1875726218333440:12345-0@lo:503: 00000100:00100000:1.0:1788832060.396377:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+15:9517:x1875726218333440:12345-0@lo:503: Request processed in 86us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832060.396382:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788832060.396423:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b063763c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832060.396435:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218333440:0@lo:503: 00000040:00080000:1.0:1788832060.397097:0:9517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788832060.397171:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218333568:0@lo:502: 00000100:00100000:1.0:1788832060.397215:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832060.397281:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376300 going to sleep for 11 seconds 00000100:00100000:3.0:1788832060.397334:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218333568 00000100:00100000:3.0:1788832060.397342:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218333568 00000100:00100000:3.0:1788832060.397378:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788832060.397386:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:9517:x1875726218333568:12345-0@lo:502: 00000100:00100000:3.0:1788832060.397833:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:9517:x1875726218333568:12345-0@lo:502: Request processed in 446us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832060.397841:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788832060.397918:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218333568:0@lo:502: 00000040:00080000:1.0:1788832060.398131:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788832060.398168:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788832060.398181:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788832060.398191:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788832060.398204:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788832060.398217:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788832060.398239:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218333696:0@lo:502: 00000100:00100000:1.0:1788832060.398275:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832060.398310:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376300 going to sleep for 11 seconds 00000100:00100000:0.0:1788832060.398362:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218333696 00000100:00100000:0.0:1788832060.398367:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218333696 00000100:00100000:0.0:1788832060.398402:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788832060.398410:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+15:9517:x1875726218333696:12345-0@lo:502: 00000100:00100000:0.0:1788832060.398601:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+15:9517:x1875726218333696:12345-0@lo:502: Request processed in 191us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832060.398609:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788832060.398835:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218333696:0@lo:502: 00000040:00080000:2.0:1788832060.398882:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788832060.398890:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1788832060.399275:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788832060.399283:0:9528:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788832060.399289:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832060.399291:0:9528:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788832060.399299:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788832060.399314:0:9528:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9d2c3e77cd28) 00000020:00000080:2.0:1788832060.399335:0:9528:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788832060.399341:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788832060.399412:0:9528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d2c3fcaa000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788832060.399420:0:9528:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788832060.399426:0:9528:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x998c12b283536e66 00010000:00010000:3.0:1788832060.403001:0:9528:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1788832060.403968:0:9528:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788832060.407033:0:9528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788832060.407398:0:9528:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788832060.412414:0:9528:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788832060.412674:0:9528:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788832060.417590:0:9528:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788832060.418917:0:9528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788832060.418929:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832060.418935:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832060.418937:0:9528:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788832060.418941:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832060.418945:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832060.418947:0:9528:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788832060.418949:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788832060.418951:0:9528:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788832060.418972:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832060.418975:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832060.418976:0:9528:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788832060.418979:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788832060.419254:0:9517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788832060.419284:0:9517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788832060.419310:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd600/0x998c12b283536e51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536e58 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.419328:0:9517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd600/0x998c12b283536e51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536e58 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832060.419406:0:9517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2c3fcaa000 from 1 10000000:01000000:1.0:1788832060.419410:0:9517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788832060.419446:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536e6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.419454:0:9517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536e6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.419465:0:9517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536e6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832060.419497:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218333824:0@lo:101: 00000100:00100000:1.0:1788832060.420318:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832060.420368:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376480 going to sleep for 11 seconds 00000100:00100000:3.0:1788832060.421156:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218333824 00000100:00100000:3.0:1788832060.421165:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218333824 00000100:00100000:3.0:1788832060.421221:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788832060.421230:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:9517:x1875726218333824:12345-0@lo:101: 00010000:00010000:3.0:1788832060.421245:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832060.421261:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536e6d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.421285:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536e6d expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.421296:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536e6d expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832060.421312:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d3e00, rc 0) 00000100:00100000:3.0:1788832060.421647:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+16:9517:x1875726218333824:12345-0@lo:101: Request processed in 416us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832060.421654:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788832060.421661:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218333824:0@lo:101: 00010000:00010000:2.0:1788832060.421678:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536e6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536e74 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.421688:0:9517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536e6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536e74 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832060.421814:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218333952:0@lo:501: 00000100:00100000:2.0:1788832060.421845:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832060.421876:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032f6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788832060.421931:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218333952 00000100:00100000:0.0:1788832060.421936:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218333952 00000100:00100000:0.0:1788832060.421971:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788832060.421977:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+16:9517:x1875726218333952:12345-0@lo:501: 00000100:00100000:0.0:1788832060.422072:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+16:9517:x1875726218333952:12345-0@lo:501: Request processed in 95us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832060.422078:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788832060.422142:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218333952:0@lo:501: 00000100:00100000:2.0:1788832060.422168:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218334080:0@lo:503: 00000100:00100000:2.0:1788832060.422204:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832060.422227:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032f6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788832060.422265:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218334080 00000100:00100000:0.0:1788832060.422269:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218334080 00000100:00100000:0.0:1788832060.422394:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788832060.422403:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+16:9517:x1875726218334080:12345-0@lo:503: 00000100:00100000:0.0:1788832060.422480:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+16:9517:x1875726218334080:12345-0@lo:503: Request processed in 78us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832060.422535:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218334080:0@lo:503: 00000040:00080000:2.0:1788832060.422800:0:9517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788832060.422873:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218334208:0@lo:502: 00000100:00100000:2.0:1788832060.422909:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832060.422930:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032f6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788832060.422944:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218334208 00000100:00100000:2.0:1788832060.422948:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218334208 00000100:00100000:2.0:1788832060.422972:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788832060.422979:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:9517:x1875726218334208:12345-0@lo:502: 00000100:00100000:2.0:1788832060.423058:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:9517:x1875726218334208:12345-0@lo:502: Request processed in 79us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832060.423066:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788832060.423107:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218334208:0@lo:502: 00000040:00080000:2.0:1788832060.423311:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788832060.423337:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788832060.423356:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218334336:0@lo:502: 00000100:00100000:2.0:1788832060.423386:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832060.423406:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032f6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788832060.423419:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218334336 00000100:00100000:2.0:1788832060.423422:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218334336 00000100:00100000:2.0:1788832060.423443:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788832060.423449:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:9517:x1875726218334336:12345-0@lo:502: 00000100:00100000:2.0:1788832060.423511:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:9517:x1875726218334336:12345-0@lo:502: Request processed in 62us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832060.423517:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788832060.423555:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218334336:0@lo:502: 00000040:00080000:2.0:1788832060.423587:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788832060.423594:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000100:00100000:0.0:1788832060.423848:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000020:01000000:2.0:1788832060.424027:0:9532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832060.424036:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832060.424038:0:9532:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788832060.424045:0:9532:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d2c3fcaa000 00000020:00000080:2.0:1788832060.424047:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788832060.424058:0:9532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832060.424061:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832060.424063:0:9532:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788832060.424066:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788832060.424288:0:9517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788832060.424369:0:9517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788832060.424420:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536e6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536e74 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.424442:0:9517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536e6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536e74 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832060.424491:0:9517:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788832060.424494:0:9517:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d2c3fcaa000 10000000:01000000:0.0:1788832060.424496:0:9517:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d2c3fcaa000 10000000:01000000:0.0:1788832060.424501:0:9517:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788832060.424508:0:9517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d2c3fcaa000 from 1 10000000:01000000:0.0:1788832060.424510:0:9517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788832060.424552:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8200/0x998c12b283536e7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.424559:0:9517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8200/0x998c12b283536e7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.424569:0:9517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8200/0x998c12b283536e7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832060.424585:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06612300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218334464:0@lo:101: 00000100:00100000:0.0:1788832060.424651:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832060.424678:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c07c4a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788832060.424801:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218334464 00000100:00100000:2.0:1788832060.424808:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218334464 00000100:00100000:2.0:1788832060.424871:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788832060.424879:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+16:9517:x1875726218334464:12345-0@lo:101: 00010000:00010000:2.0:1788832060.424889:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832060.424901:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c092dda00/0x998c12b283536e82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536e7b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.424920:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c092dda00/0x998c12b283536e82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536e7b expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.424941:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c092dda00/0x998c12b283536e82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536e7b expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.424950:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dda00, rc 0) 00000100:00100000:2.0:1788832060.424990:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:9517:x1875726218334464:12345-0@lo:101: Request processed in 112us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832060.424996:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788832060.425059:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06612300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218334464:0@lo:101: 00010000:00010000:1.0:1788832060.425072:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8200/0x998c12b283536e7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536e82 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.425080:0:9517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8200/0x998c12b283536e7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536e82 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832060.425151:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218334592:0@lo:501: 00000100:00100000:1.0:1788832060.425184:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832060.425270:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b063760c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832060.425364:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218334592 00000100:00100000:0.0:1788832060.425368:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218334592 00000100:00100000:0.0:1788832060.425390:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788832060.425397:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+17:9517:x1875726218334592:12345-0@lo:501: 00000100:00100000:0.0:1788832060.425481:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+17:9517:x1875726218334592:12345-0@lo:501: Request processed in 85us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832060.425487:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788832060.428411:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218334592:0@lo:501: 00000100:00100000:1.0:1788832060.428489:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218334720:0@lo:503: 00000100:00100000:1.0:1788832060.428791:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832060.428866:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b063760c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832060.428919:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218334720 00000100:00100000:0.0:1788832060.428927:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218334720 00000100:00100000:0.0:1788832060.429011:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788832060.429022:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+17:9517:x1875726218334720:12345-0@lo:503: 00000100:00100000:0.0:1788832060.429148:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+17:9517:x1875726218334720:12345-0@lo:503: Request processed in 127us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832060.429155:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788832060.429239:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218334720:0@lo:503: 00000040:00080000:1.0:1788832060.429476:0:9517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788832060.429555:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218334848:0@lo:502: 00000100:00100000:1.0:1788832060.429594:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832060.429962:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b063760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832060.430032:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218334848 00000100:00100000:2.0:1788832060.430038:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218334848 00000100:00100000:2.0:1788832060.430067:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788832060.430074:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:9517:x1875726218334848:12345-0@lo:502: 00000100:00100000:2.0:1788832060.430167:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:9517:x1875726218334848:12345-0@lo:502: Request processed in 93us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832060.430174:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788832060.430252:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218334848:0@lo:502: 00000040:00080000:1.0:1788832060.430442:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788832060.430469:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788832060.430483:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788832060.430495:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788832060.430507:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788832060.430722:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788832060.430740:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788832060.430754:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788832060.430782:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788832060.430797:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788832060.430811:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788832060.430823:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788832060.430835:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788832060.430847:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788832060.430859:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788832060.430870:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788832060.430883:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788832060.430894:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788832060.430905:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788832060.430930:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788832060.430942:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788832060.430954:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788832060.430965:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788832060.430978:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788832060.431004:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788832060.431021:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788832060.431035:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788832060.431047:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1788832060.431057:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788832060.431068:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1788832060.431080:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1788832060.431093:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1788832060.431105:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1788832060.431118:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1788832060.431130:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1788832060.431143:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1788832060.431155:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1788832060.431168:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1788832060.431180:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1788832060.431190:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1788832060.431211:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1788832060.431223:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1788832060.431235:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1788832060.431248:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1788832060.431259:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1788832060.431270:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1788832060.431312:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218334976:0@lo:502: 00000100:00100000:1.0:1788832060.431362:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832060.431402:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b063760c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832060.431548:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218334976 00000100:00100000:3.0:1788832060.431554:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218334976 00000100:00100000:3.0:1788832060.431594:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788832060.431602:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+17:9517:x1875726218334976:12345-0@lo:502: 00000100:00100000:3.0:1788832060.431739:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+17:9517:x1875726218334976:12345-0@lo:502: Request processed in 137us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832060.431757:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788832060.431814:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218334976:0@lo:502: 00000040:00080000:1.0:1788832060.431866:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1788832060.431875:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1788832060.432456:0:9533:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788832060.432471:0:9533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9d2c358299b8) 00000020:00000080:3.0:1788832060.432493:0:9533:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1788832060.432822:0:9533:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d2c3fcaa000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788832060.432827:0:9533:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d2c3fcaa000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788832060.432830:0:9533:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d2c3fcaa000 3 00010000:00080000:3.0:1788832060.432858:0:9533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2b057ea800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.126@tcp at head 00010000:00010000:3.0:1788832060.438974:0:9533:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1788832060.439247:0:9533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788832060.439290:0:9533:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788832060.439316:0:9533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x998c12b283536e90 00000100:00080000:3.0:1788832060.439328:0:9533:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788832060.439335:0:9533:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d2b057ea800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788832060.439372:0:9533:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b067f1880 x1875726218335104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788832060.441028:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1875726218335104:0@lo:38: 00000100:00100000:3.0:1788832060.441105:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832060.441177:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218335104 00000100:00100000:3.0:1788832060.441184:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218335104 00000100:00100000:3.0:1788832060.441219:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788832060.441226:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1875726218335104:12345-0@lo:38: 00010000:00080000:3.0:1788832060.441254:0:6526:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:3.0:1788832060.441291:0:6526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x998c12b283536e97 00000004:00100000:3.0:1788832060.441307:0:6526:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788832060.441339:0:6526:0:(import.c:65:import_set_state_nolock()) ffff9d2b073a7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788832060.441475:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875726218335104:12345-0@lo:38: Request processed in 247us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832060.441482:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788832060.441540:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b067f1880 x1875726218335104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788832070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832060.441552:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788832060.441560:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788832060.441568:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788832060.441573:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788832060.441575:0:9533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788832060.441576:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2b057ea800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788832060.441586:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1875726218335104:0@lo:38: 00000020:01000004:3.0:1788832060.444218:0:9533:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788832060.444247:0:9533:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9d2b073e0000) 00000020:00000080:3.0:1788832060.444272:0:9533:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1788832060.444364:0:9533:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d2c3fcaa000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788832060.444369:0:9533:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d2c3fcaa000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788832060.444371:0:9533:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d2c3fcaa000 3 00010000:00080000:3.0:1788832060.444402:0:9533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2b073a5000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.126@tcp at head 00000100:00100000:1.0:1788832060.445985:0:9535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb8700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9535:1875726218335232:0@lo:901: 00000100:00100000:1.0:1788832060.446053:0:9535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832060.446089:0:9535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376b40 going to sleep for 11 seconds 00010000:00010000:3.0:1788832060.446554:0:9533:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00100000:2.0:1788832060.448612:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218335232 00000100:00100000:2.0:1788832060.448642:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218335232 00000100:00100000:2.0:1788832060.448727:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788832060.448746:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9535:x1875726218335232:12345-0@lo:901: 00000100:00100000:2.0:1788832060.448875:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9535:x1875726218335232:12345-0@lo:901: Request processed in 139us (2820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832060.448882:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788832060.448979:0:9535:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fcb8700 x1875726218335232/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788832076 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788832060.448986:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832060.448997:0:9535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb8700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9535:1875726218335232:0@lo:901: 00000020:00000080:3.0:1788832060.450057:0:9533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788832060.450110:0:9533:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788832060.450126:0:9533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x998c12b283536ea5 00000100:00080000:3.0:1788832060.450135:0:9533:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788832060.450141:0:9533:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9d2b073a5000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788832060.450270:0:9533:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b067f0a80 x1875726218335360/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788832060.450478:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1875726218335360:0@lo:38: 00000100:00080000:3.0:1788832060.450534:0:9533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788832060.451398:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832060.451603:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218335360 00000100:00100000:3.0:1788832060.451611:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218335360 00000100:00100000:0.0:1788832060.451690:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788832060.451707:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3650:x1875726218335360:12345-0@lo:38: 00010000:00080000:0.0:1788832060.451743:0:8742:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:0.0:1788832060.451778:0:8742:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x998c12b283536eac 00000004:00100000:0.0:1788832060.451793:0:8742:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788832060.451821:0:8742:0:(import.c:65:import_set_state_nolock()) ffff9d2c36d22000 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1788832060.451833:0:9533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000100:00100000:0.0:1788832060.451888:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875726218335360:12345-0@lo:38: Request processed in 188us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832060.451896:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788832060.451911:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b067f0a80 x1875726218335360/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788832070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832060.451923:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788832060.451930:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788832060.451938:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788832060.451943:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788832060.451946:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2b073a5000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788832060.451960:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1875726218335360:0@lo:38: 00000020:01000000:0.0:1788832060.452008:0:9517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1788832060.452038:0:9517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788832060.452058:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8200/0x998c12b283536e7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536e82 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.452069:0:9517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8200/0x998c12b283536e7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536e82 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788832060.452115:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788832060.452117:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788832060.452118:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832060.452119:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832060.452121:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832060.452125:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832060.452126:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788832060.452127:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788832060.452129:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788832060.452130:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832060.452131:0:9517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788832060.452135:0:9517:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788832060.452137:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788832060.452138:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788832060.452139:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832060.452140:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832060.452141:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832060.452142:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832060.452143:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788832060.452144:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788832060.452144:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788832060.452145:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832060.452146:0:9517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788832060.452162:0:9517:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788832060.452176:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06611180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218335488:0@lo:253: 00000100:00100000:0.0:1788832060.452212:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832060.452246:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c07c4ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832060.452247:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218335488 00000100:00100000:3.0:1788832060.452251:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218335488 00000100:00100000:3.0:1788832060.452287:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788832060.452294:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+17:9517:x1875726218335488:12345-0@lo:253: 20000000:01000000:3.0:1788832060.452314:0:6519:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788832060.452326:0:6519:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788832060.460411:0:6519:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788832060.460430:0:6519:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788832060.460547:0:6541:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788832060.460553:0:6541:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788832060.460576:0:6541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d2c092dc000/0x998c12b283536eb3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.460609:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c092dde00/0x998c12b283536da9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536da2 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.460771:0:6541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c36db8e00/0x998c12b283536def lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536de8 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.460782:0:6541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d2c092dc000/0x998c12b283536eb3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.460823:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c36db8e00/0x998c12b283536def lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536de8 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.460837:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c36db8e00/0x998c12b283536def lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536de8 expref: 17 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832060.460851:0:6541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1875726218335616:0@lo:104: 00000100:00100000:2.0:1788832060.460911:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788832060.461183:0:6541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c092dde00/0x998c12b283536da9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536da2 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.461192:0:6541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c092dde00/0x998c12b283536da9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536da2 expref: 17 pid: 6517 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832060.461201:0:6541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1875726218335744:0@lo:104: 00000100:00100000:2.0:1788832060.461224:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832060.461824:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+17:9517:x1875726218335488:12345-0@lo:253: Request processed in 9529us (9609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832060.461835:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788832060.463375:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06611180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e55f0905-9d39-4464-9830-326b420fb582:9517:1875726218335488:0@lo:253: 10000000:01000000:3.0:1788832060.463396:0:9517:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788832060.463400:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788832060.463402:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788832060.463403:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788832060.463404:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788832060.463405:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788832060.463407:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788832060.463408:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788832060.463409:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788832060.463411:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788832060.463412:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788832060.463414:0:9517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788832060.463434:0:9517:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788832060.467886:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218335616 00000100:00100000:0.0:1788832060.467901:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218335616 00000100:00100000:1.0:1788832060.468761:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218335744 00000100:00100000:1.0:1788832060.468768:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218335744 00000100:00100000:1.0:1788832060.468823:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788832060.468833:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+4:6541:x1875726218335744:12345-0@lo:104: 00010000:00010000:1.0:1788832060.468850:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c00031c00/0x998c12b283536da2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536da9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.468940:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788832060.468946:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+4:6541:x1875726218335744:12345-0@lo:104: Request processed in 115us (7720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832060.468953:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1788832060.468975:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832060.468981:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c00031c00/0x998c12b283536da2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536da9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.468988:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031c00 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:1.0:1788832060.468992:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c00031c00/0x998c12b283536da2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536da9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.468999:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c00031c00/0x998c12b283536da2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536da9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788832060.469007:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c00031c00/0x998c12b283536da2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536da9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832060.469026:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788832060.469074:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c00031c00/0x998c12b283536da2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536da9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.469081:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788832060.469115:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c00031c00/0x998c12b283536da2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536da9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.469123:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c00031c00/0x998c12b283536da2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536da9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832060.469131:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1788832060.469138:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832060.469141:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832060.469143:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832060.469151:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218335872:0@lo:103: 00000100:00100000:1.0:1788832060.469176:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788832060.469185:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+3:6541:x1875726218335616:12345-0@lo:104: 00010000:00010000:1.0:1788832060.469194:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536de8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536def expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832060.469204:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788832060.469246:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788832060.469253:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+3:6541:x1875726218335616:12345-0@lo:104: Request processed in 69us (8342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832060.469258:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788832060.469276:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832060.469280:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536de8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536def expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.469286:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031600 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:1.0:1788832060.469294:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536de8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536def expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.469301:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536de8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536def expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788832060.469306:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536de8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536def expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832060.469311:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788832060.469338:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536de8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536def expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.469344:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788832060.469355:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536de8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536def expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.469361:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c00031600/0x998c12b283536de8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536def expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832060.469374:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832060.469375:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832060.469377:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832060.469387:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218336000:0@lo:103: 00000100:00100000:1.0:1788832060.469414:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832060.469489:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218335872 00000100:00100000:0.0:1788832060.469494:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218335872 00010000:00010000:0.0:1788832060.469517:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c092dde00/0x998c12b283536da9 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536da2 expref: 17 pid: 6517 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832060.469554:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218336000 00000100:00100000:0.0:1788832060.469557:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218336000 00010000:00010000:0.0:1788832060.469579:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c36db8e00/0x998c12b283536def lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536de8 expref: 18 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832060.469612:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788832060.469642:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06611c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+18:3654:x1875726218335872:12345-0@lo:103: 00010000:00010000:0.0:1788832060.469653:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832060.469659:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c092dde00/0x998c12b283536da9 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536da2 expref: 18 pid: 6517 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.469669:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c092dde00/0x998c12b283536da9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536da2 expref: 18 pid: 6517 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.469685:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832060.469726:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06611c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+18:3654:x1875726218335872:12345-0@lo:103: Request processed in 107us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832060.469733:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788832060.469750:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788832060.469756:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+17:3654:x1875726218336000:12345-0@lo:103: 00010000:00010000:0.0:1788832060.469764:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832060.469767:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c36db8e00/0x998c12b283536def lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536de8 expref: 17 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.469776:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c36db8e00/0x998c12b283536def lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536de8 expref: 17 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.469788:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d2c092dc000/0x998c12b283536eb3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.469795:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c092dc000/0x998c12b283536eb3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788832060.469818:0:6512:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009266539s 00010000:00010000:0.0:1788832060.469823:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c092dc000/0x998c12b283536eb3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.469831:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c092dc000/0x998c12b283536eb3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.469838:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d2c092dc000/0x998c12b283536eb3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.469844:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d2c092dc000/0x998c12b283536eb3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.469849:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc000 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:0.0:1788832060.469852:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d2c092dc000/0x998c12b283536eb3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.469859:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d2c092dc000/0x998c12b283536eb3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.469867:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d2c092dc000/0x998c12b283536eb3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832060.469875:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832060.469896:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+17:3654:x1875726218336000:12345-0@lo:103: Request processed in 141us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832060.469902:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788832060.470051:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218336000:0@lo:103: 00000100:00100000:1.0:1788832060.470060:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218335872:0@lo:103: 00000100:00100000:2.0:1788832060.473667:0:6541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032f6f00 going to sleep for 11 seconds 00010000:00010000:2.0:1788832060.473935:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c36db8e00/0x998c12b283536def lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536de8 expref: 16 pid: 6518 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832060.473978:0:6541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1875726218335616:0@lo:104: 00010000:00010000:2.0:1788832060.473993:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c092dde00/0x998c12b283536da9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536da2 expref: 15 pid: 6517 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832060.474002:0:6541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6541:1875726218335744:0@lo:104: 00010000:00010000:2.0:1788832060.474026:0:6541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d2c092dc000/0x998c12b283536eb3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.474036:0:6541:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d2c092dc000/0x998c12b283536eb3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.474043:0:6541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d2c092dc000/0x998c12b283536eb3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832060.474049:0:6541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c092dc000/0x998c12b283536eb3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788832060.475389:0:9517:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788832060.475825:0:9517:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788832060.476040:0:9517:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788832060.476198:0:9517:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788832060.479032:0:9517:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788832060.479447:0:9517:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1788832060.486995:0:9517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788832060.503060:0:9517:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788832060.503071:0:9517:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788832060.503109:0:9517:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788832060.503151:0:9517:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788832060.503171:0:9517:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788832060.503191:0:9517:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788832060.504076:0:9517:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788832060.504259:0:9517:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:0.0:1788832060.632522:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218336128:0@lo:13: 00000100:00100000:0.0:1788832060.632592:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832060.632759:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218336128 00000100:00100000:2.0:1788832060.632768:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218336128 00000100:00100000:2.0:1788832060.632909:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788832060.632920:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218336128:12345-0@lo:13: 00002000:00000024:2.0:1788832060.632944:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788832060.635513:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218336128:12345-0@lo:13: Request processed in 2587us (2912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832060.635527:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788832060.637309:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fcb9880 x1875726218336128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832060.637337:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218336128:0@lo:13: 00010000:00010000:1.0:1788832060.887004:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788832061.350344:0:9588:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788832061.350571:0:9588:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788832061.916315:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832062.934794:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832063.192298:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218336256:0@lo:41: 00000100:00100000:1.0:1788832063.192370:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832063.192537:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218336256 00000100:00100000:2.0:1788832063.192545:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218336256 00000100:00100000:2.0:1788832063.192598:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788832063.192608:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218336256:12345-0@lo:41: 00000004:00000024:2.0:1788832063.192671:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788832063.192731:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218336256:12345-0@lo:41: Request processed in 123us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832063.192738:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788832063.192840:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218336256:0@lo:41: 00000100:00100000:2.0:1788832063.703057:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788832063.706169:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218336384:0@lo:41: 00000100:00100000:2.0:1788832063.706252:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832063.706441:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218336384 00000100:00100000:1.0:1788832063.706450:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218336384 00000100:00100000:1.0:1788832063.706504:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788832063.706513:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218336384:12345-0@lo:41: 00000004:00000024:1.0:1788832063.706547:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1788832063.706598:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218336384:12345-0@lo:41: Request processed in 85us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832063.706605:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788832063.708559:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218336384:0@lo:41: 00010000:00010000:3.0:1788832063.959468:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832064.982792:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832065.239384:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218336512:0@lo:13: 00000100:00100000:2.0:1788832065.239454:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832065.239527:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218336512 00000100:00100000:2.0:1788832065.239535:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218336512 00000100:00100000:2.0:1788832065.239585:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788832065.239596:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218336512:12345-0@lo:13: 00002000:00000024:2.0:1788832065.239654:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788832065.239707:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218336512:12345-0@lo:13: Request processed in 113us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832065.239714:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788832065.239735:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788832065.239767:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f6680 x1875726218336512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832065.239785:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218336512:0@lo:13: 00000001:02000400:2.0:1788832065.360219:0:9877:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788832065.750785:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832065.750817:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218336640:0@lo:13: 00000100:00100000:2.0:1788832065.750889:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832065.750958:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218336640 00000100:00100000:0.0:1788832065.750965:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218336640 00000100:00100000:0.0:1788832065.751027:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788832065.751039:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218336640:12345-0@lo:13: 00002000:00000024:0.0:1788832065.751060:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832065.751116:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218336640:12345-0@lo:13: Request processed in 81us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832065.751125:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788832065.751144:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f6680 x1875726218336640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832065.751168:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218336640:0@lo:13: 00000100:00100000:0.0:1788832065.752007:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218337152:0@lo:400: 00000100:00100000:0.0:1788832065.752047:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832065.752070:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1875726218337664:0@lo:400: 00000100:00100000:0.0:1788832065.752113:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832065.752141:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788832065.752151:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218336768:0@lo:400: 00000100:00100000:0.0:1788832065.752187:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832065.752232:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218337280:0@lo:400: 00000100:00100000:0.0:1788832065.752263:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832065.752304:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218337792:0@lo:400: 00000100:00100000:0.0:1788832065.752334:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832065.752372:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218336768 00000100:00100000:0.0:1788832065.752377:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218336768 00000100:00100000:0.0:1788832065.752411:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788832065.752418:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+15:3651:x1875726218336768:12345-0@lo:400: 00000100:00100000:3.0:1788832065.752429:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218337152 00000100:00100000:3.0:1788832065.752433:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218337152 00000100:00100000:0.0:1788832065.752462:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+15:3651:x1875726218336768:12345-0@lo:400: Request processed in 44us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832065.752474:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788832065.752502:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218337280 00000100:00100000:0.0:1788832065.752506:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218337280 00000100:00100000:3.0:1788832065.752517:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218337664 00000100:00100000:3.0:1788832065.752520:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218337664 00000100:00100000:3.0:1788832065.752537:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218337792 00000100:00100000:3.0:1788832065.752540:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218337792 00000100:00100000:3.0:1788832065.752554:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788832065.752560:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218337152:12345-0@lo:400: 00000100:00100000:3.0:1788832065.752596:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218337152:12345-0@lo:400: Request processed in 36us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832065.752602:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788832065.752615:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788832065.752640:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875726218337664:12345-0@lo:400: 00000100:00100000:3.0:1788832065.753150:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875726218337664:12345-0@lo:400: Request processed in 528us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832065.753159:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788832065.753174:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788832065.753180:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875726218337792:12345-0@lo:400: 00000100:00100000:3.0:1788832065.753211:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875726218337792:12345-0@lo:400: Request processed in 32us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832065.753216:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788832065.753910:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788832065.753922:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218337280:12345-0@lo:400: 00000100:00100000:0.0:1788832065.753968:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218337280:12345-0@lo:400: Request processed in 51us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832065.753974:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788832065.754023:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218336768:0@lo:400: 00000100:00100000:0.0:1788832065.754036:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218337280:0@lo:400: 00010000:00080000:0.0:1788832065.754048:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3e775880 x1875726218337792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832065.754059:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e775880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218337792:0@lo:400: 00010000:00080000:0.0:1788832065.754069:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c182aa300 x1875726218337152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832065.754077:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218337152:0@lo:400: 00010000:00080000:0.0:1788832065.754087:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3e775f80 x1875726218337664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832065.754094:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1875726218337664:0@lo:400: 00000100:00080000:3.0:1788832065.755820:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788832065.755831:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788832065.755837:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832065.756223:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218336896:0@lo:400: 00000100:00100000:2.0:1788832065.756287:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832065.756322:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218337408:0@lo:400: 00000100:00100000:2.0:1788832065.756355:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832065.756380:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788832065.756386:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218337024:0@lo:400: 00000100:00100000:2.0:1788832065.756409:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832065.756427:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218337536:0@lo:400: 00000100:00100000:2.0:1788832065.756445:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832065.756475:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218337024 00000100:00100000:2.0:1788832065.756482:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218337024 00000100:00100000:2.0:1788832065.756523:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788832065.756533:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218337024:12345-0@lo:400: 00000100:00100000:2.0:1788832065.756594:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218337024:12345-0@lo:400: Request processed in 62us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832065.756601:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788832065.756639:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218336896 00000100:00100000:2.0:1788832065.756643:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218336896 00000100:00100000:2.0:1788832065.756679:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218337408 00000100:00100000:2.0:1788832065.756682:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218337408 00000100:00100000:0.0:1788832065.756692:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218337536 00000100:00100000:0.0:1788832065.756699:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218337536 00000100:00100000:2.0:1788832065.756713:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788832065.756722:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218336896:12345-0@lo:400: 00000100:00100000:3.0:1788832065.756774:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218337024:0@lo:400: 00000100:00100000:0.0:1788832065.756808:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788832065.756831:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218337408:12345-0@lo:400: 00000100:00100000:2.0:1788832065.758744:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218336896:12345-0@lo:400: Request processed in 2016us (2449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832065.758756:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788832065.758799:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788832065.758810:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218337536:12345-0@lo:400: 00000100:00100000:2.0:1788832065.758878:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218337536:12345-0@lo:400: Request processed in 71us (2430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832065.758884:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788832065.758929:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788832065.758935:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788832065.759373:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b06610700 x1875726218336896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832065.759648:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218336896:0@lo:400: 00010000:00080000:3.0:1788832065.759861:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c182ab800 x1875726218337536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832065.759872:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218337536:0@lo:400: 00000100:00100000:0.0:1788832065.760915:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218337408:12345-0@lo:400: Request processed in 4080us (4553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832065.760925:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788832065.761475:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c182aa680 x1875726218337408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832065.761491:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218337408:0@lo:400: 00010000:00010000:3.0:1788832066.007853:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788832066.067316:0:9929:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788832066.067548:0:9929:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788832067.031546:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832068.066334:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832068.311815:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218337920:0@lo:41: 00000100:00100000:2.0:1788832068.311887:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832068.311976:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218337920 00000100:00100000:3.0:1788832068.311984:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218337920 00000100:00100000:3.0:1788832068.312041:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788832068.312053:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218337920:12345-0@lo:41: 00000004:00000024:3.0:1788832068.312087:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788832068.312153:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218337920:12345-0@lo:41: Request processed in 102us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832068.312161:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788832068.312712:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218337920:0@lo:41: 00000020:00000004:2.0:1788832068.524556:0:10031:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788832068.525334:0:10031:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788832068.823024:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832068.823050:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218338048:0@lo:41: 00000100:00100000:2.0:1788832068.823128:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832068.823283:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218338048 00000100:00100000:3.0:1788832068.823291:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218338048 00000100:00100000:3.0:1788832068.823342:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788832068.823352:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218338048:12345-0@lo:41: 00000004:00000024:3.0:1788832068.823385:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1788832068.823441:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218338048:12345-0@lo:41: Request processed in 89us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832068.823448:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788832068.823540:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218338048:0@lo:41: 00010000:00010000:1.0:1788832069.078720:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788832069.334818:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788832069.334828:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d2c3e677800 from 39 10000000:01000000:0.0:1788832069.334834:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788832069.334883:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9800/0x998c12b283536eba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.334896:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9800/0x998c12b283536eba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.334906:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9800/0x998c12b283536eba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832069.334932:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218338176:0@lo:101: 00000100:00100000:0.0:1788832069.335005:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832069.342086:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218338176 00000100:00100000:0.0:1788832069.342304:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fb3c0 going to sleep for 11 seconds 00000020:00000004:3.0:1788832069.342318:0:10079:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788832069.342325:0:10079:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1788832069.342360:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218338176 00000100:00100000:2.0:1788832069.342457:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788832069.342467:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+15:6522:x1875726218338176:12345-0@lo:101: 00010000:00010000:2.0:1788832069.342484:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832069.342504:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c092dd000/0x998c12b283536ec1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536eba expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832069.342543:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c092dd000/0x998c12b283536ec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536eba expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832069.342555:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c092dd000/0x998c12b283536ec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536eba expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832069.342565:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dd000, rc 0) 00000100:00100000:2.0:1788832069.342678:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218338176:12345-0@lo:101: Request processed in 212us (7673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832069.342685:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788832069.342833:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218338176:0@lo:101: 00010000:00010000:1.0:1788832069.342850:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9800/0x998c12b283536eba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536ec1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832069.342859:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9800/0x998c12b283536eba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536ec1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832069.342931:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218338304:0@lo:501: 00000100:00100000:1.0:1788832069.342967:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.343340:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218338304 00000100:00100000:0.0:1788832069.343346:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218338304 00000100:00100000:0.0:1788832069.343377:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788832069.343385:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218338304:12345-0@lo:501: 00000100:00100000:1.0:1788832069.343589:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c07c4a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832069.343683:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218338304:12345-0@lo:501: Request processed in 298us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832069.343691:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788832069.343909:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218338304:0@lo:501: 00000100:00100000:1.0:1788832069.343945:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218338432:0@lo:503: 00000100:00100000:1.0:1788832069.344225:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832069.344287:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c07c4a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832069.344314:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218338432 00000100:00100000:0.0:1788832069.344319:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218338432 00000100:00100000:0.0:1788832069.344357:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788832069.344370:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218338432:12345-0@lo:503: 00000100:00100000:0.0:1788832069.344529:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218338432:12345-0@lo:503: Request processed in 159us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832069.344537:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788832069.344605:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218338432:0@lo:503: 00000100:00100000:1.0:1788832069.349528:0:10080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10080:1875726218338560:0@lo:502: 00000100:00100000:1.0:1788832069.349606:0:10080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832069.349670:0:10080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c07c4ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832069.350536:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218338560 00000100:00100000:3.0:1788832069.350545:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218338560 00000100:00100000:3.0:1788832069.350598:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788832069.350609:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+16:10080:x1875726218338560:12345-0@lo:502: 00000100:00100000:3.0:1788832069.351005:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+16:10080:x1875726218338560:12345-0@lo:502: Request processed in 396us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832069.351013:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788832069.351224:0:10080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10080:1875726218338560:0@lo:502: 00000100:00100000:1.0:1788832069.351298:0:10080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10080:1875726218338688:0@lo:502: 00000100:00100000:1.0:1788832069.351342:0:10080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832069.351380:0:10080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c07c4ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832069.351383:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218338688 00000100:00100000:0.0:1788832069.351388:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218338688 00000100:00100000:0.0:1788832069.351568:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788832069.351577:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+16:10080:x1875726218338688:12345-0@lo:502: 00000100:00100000:0.0:1788832069.351708:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+16:10080:x1875726218338688:12345-0@lo:502: Request processed in 131us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832069.351715:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788832069.352497:0:10080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10080:1875726218338688:0@lo:502: 00000040:00080000:1.0:1788832069.352533:0:10080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788832069.354347:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788832069.354388:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788832069.354880:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9800/0x998c12b283536eba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536ec1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832069.354892:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9800/0x998c12b283536eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536ec1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832069.354902:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788832069.354905:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788832069.354907:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788832069.354949:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dca00/0x998c12b283536ec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832069.354956:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c092dca00/0x998c12b283536ec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832069.354966:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c092dca00/0x998c12b283536ec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832069.355004:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218338816:0@lo:101: 00000100:00100000:2.0:1788832069.355068:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832069.355107:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c076d9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832069.355123:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218338816 00000100:00100000:3.0:1788832069.355131:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218338816 00000100:00100000:3.0:1788832069.355178:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788832069.355187:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218338816:12345-0@lo:101: 00010000:00010000:3.0:1788832069.355200:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832069.355214:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c421d2c00/0x998c12b283536ecf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536ec8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832069.355237:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d2c00/0x998c12b283536ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536ec8 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832069.355255:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c421d2c00/0x998c12b283536ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536ec8 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832069.355264:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2c00, rc 0) 00000100:00100000:3.0:1788832069.355315:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218338816:12345-0@lo:101: Request processed in 129us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832069.355322:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788832069.355394:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218338816:0@lo:101: 00010000:00010000:1.0:1788832069.355408:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c092dca00/0x998c12b283536ec8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536ecf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832069.355417:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dca00/0x998c12b283536ec8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536ecf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832069.355472:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218338944:0@lo:501: 00000100:00100000:1.0:1788832069.355498:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832069.355520:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c07c4ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832069.355908:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218338944 00000100:00100000:0.0:1788832069.355914:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218338944 00000100:00100000:0.0:1788832069.355952:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788832069.355959:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218338944:12345-0@lo:501: 00000100:00100000:0.0:1788832069.356082:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218338944:12345-0@lo:501: Request processed in 123us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832069.356089:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788832069.356107:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218338944:0@lo:501: 00000100:00100000:1.0:1788832069.356137:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218339072:0@lo:503: 00000100:00100000:1.0:1788832069.356184:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832069.356213:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c07c4ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832069.356272:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218339072 00000100:00100000:2.0:1788832069.356277:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218339072 00000100:00100000:2.0:1788832069.356310:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788832069.356317:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218339072:12345-0@lo:503: 00000100:00100000:2.0:1788832069.356414:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218339072:12345-0@lo:503: Request processed in 97us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832069.356421:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788832069.356428:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218339072:0@lo:503: 00000100:00100000:1.0:1788832069.357277:0:10081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10081:1875726218339200:0@lo:502: 00000100:00100000:1.0:1788832069.357327:0:10081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832069.357361:0:10081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c07c4a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788832069.357414:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218339200 00000100:00100000:0.0:1788832069.357419:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218339200 00000100:00100000:0.0:1788832069.357458:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788832069.357466:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:10081:x1875726218339200:12345-0@lo:502: 00000100:00100000:0.0:1788832069.357580:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:10081:x1875726218339200:12345-0@lo:502: Request processed in 114us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832069.357588:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788832069.357787:0:10081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10081:1875726218339200:0@lo:502: 00000020:01000000:1.0:1788832069.357812:0:10081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832069.357821:0:10081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832069.357823:0:10081:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788832069.357832:0:10081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788832069.357835:0:10081:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788832069.357852:0:10081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10081:1875726218339328:0@lo:502: 00000100:00100000:1.0:1788832069.357886:0:10081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832069.357913:0:10081:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c07c4a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788832069.358030:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218339328 00000100:00100000:2.0:1788832069.358035:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218339328 00000100:00100000:2.0:1788832069.358068:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788832069.358075:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+17:10081:x1875726218339328:12345-0@lo:502: 00000100:00100000:2.0:1788832069.358160:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+17:10081:x1875726218339328:12345-0@lo:502: Request processed in 84us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832069.358166:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788832069.358224:0:10081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10081:1875726218339328:0@lo:502: 00000020:01000000:1.0:1788832069.358242:0:10081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832069.358246:0:10081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832069.358248:0:10081:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788832069.358253:0:10081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788832069.358458:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788832069.358480:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788832069.358489:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dca00/0x998c12b283536ec8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536ecf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832069.358499:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c092dca00/0x998c12b283536ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536ecf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832069.358507:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788832069.358515:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d2c39185800 from 39 10000000:01000000:2.0:1788832069.358518:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788832069.358540:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc200/0x998c12b283536ed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832069.358547:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc200/0x998c12b283536ed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832069.358567:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc200/0x998c12b283536ed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832069.358582:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218339456:0@lo:101: 00000100:00100000:2.0:1788832069.358612:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832069.358664:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c076d9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832069.359239:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218339456 00000100:00100000:3.0:1788832069.359245:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218339456 00000100:00100000:3.0:1788832069.359277:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788832069.359284:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218339456:12345-0@lo:101: 00010000:00010000:3.0:1788832069.359294:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832069.359305:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536edd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536ed6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832069.359327:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536ed6 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832069.359336:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536ed6 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832069.359344:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2e00, rc 0) 00000100:00100000:3.0:1788832069.359383:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+18:6522:x1875726218339456:12345-0@lo:101: Request processed in 100us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832069.359390:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788832069.362816:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218339456:0@lo:101: 00010000:00010000:2.0:1788832069.362844:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc200/0x998c12b283536ed6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536edd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832069.362857:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc200/0x998c12b283536ed6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536edd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832069.362941:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218339584:0@lo:501: 00000100:00100000:2.0:1788832069.362999:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832069.363899:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c076d9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832069.363916:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218339584 00000100:00100000:3.0:1788832069.363924:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218339584 00000100:00100000:3.0:1788832069.364049:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788832069.364072:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+18:6522:x1875726218339584:12345-0@lo:501: 00000100:00100000:3.0:1788832069.364389:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+18:6522:x1875726218339584:12345-0@lo:501: Request processed in 319us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832069.364397:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788832069.364465:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218339584:0@lo:501: 00000100:00100000:1.0:1788832069.364507:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218339712:0@lo:503: 00000100:00100000:1.0:1788832069.364549:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832069.364601:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c07c4a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788832069.364690:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218339712 00000100:00100000:3.0:1788832069.364695:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218339712 00000100:00100000:3.0:1788832069.364756:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788832069.364764:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+18:6522:x1875726218339712:12345-0@lo:503: 00000100:00100000:3.0:1788832069.364859:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+18:6522:x1875726218339712:12345-0@lo:503: Request processed in 95us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832069.364866:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788832069.369318:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218339712:0@lo:503: 00000100:00100000:3.0:1788832069.369934:0:10083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10083:1875726218339840:0@lo:502: 00000100:00100000:3.0:1788832069.370079:0:10083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832069.370221:0:10083:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b2480 going to sleep for 11 seconds 00000100:00100000:1.0:1788832069.370319:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218339840 00000100:00100000:1.0:1788832069.370326:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218339840 00000100:00100000:1.0:1788832069.370516:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788832069.370527:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+18:10083:x1875726218339840:12345-0@lo:502: 00000100:00100000:1.0:1788832069.370765:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+18:10083:x1875726218339840:12345-0@lo:502: Request processed in 239us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832069.370773:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788832069.370975:0:10083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10083:1875726218339840:0@lo:502: 00000100:00100000:3.0:1788832069.375062:0:10083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10083:1875726218339968:0@lo:502: 00000100:00100000:3.0:1788832069.375356:0:10083:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832069.375879:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218339968 00000100:00100000:3.0:1788832069.375886:0:10083:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b2480 going to sleep for 11 seconds 00000100:00100000:2.0:1788832069.375888:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218339968 00000100:00100000:2.0:1788832069.375949:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788832069.375958:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+18:10083:x1875726218339968:12345-0@lo:502: 00000100:00100000:2.0:1788832069.376099:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+18:10083:x1875726218339968:12345-0@lo:502: Request processed in 141us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832069.376113:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788832069.376185:0:10083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10083:1875726218339968:0@lo:502: 00000040:00080000:3.0:1788832069.376209:0:10083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788832069.378894:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788832069.378931:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788832069.378955:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc200/0x998c12b283536ed6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536edd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.378968:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc200/0x998c12b283536ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536edd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832069.378980:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788832069.378982:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d2c39185800 from 6 10000000:01000000:0.0:1788832069.378985:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788832069.379030:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8600/0x998c12b283536ee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.379055:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8600/0x998c12b283536ee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.379066:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8600/0x998c12b283536ee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832069.379090:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218340096:0@lo:101: 00000100:00100000:0.0:1788832069.379153:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.379197:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832069.379300:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218340096 00000100:00100000:2.0:1788832069.379308:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218340096 00000100:00100000:2.0:1788832069.379357:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788832069.379366:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+18:6522:x1875726218340096:12345-0@lo:101: 00010000:00010000:2.0:1788832069.379379:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832069.379393:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c092dcc00/0x998c12b283536eeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536ee4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832069.379418:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c092dcc00/0x998c12b283536eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536ee4 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832069.379429:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c092dcc00/0x998c12b283536eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536ee4 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832069.379437:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dcc00, rc 0) 00000100:00100000:2.0:1788832069.379485:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+19:6522:x1875726218340096:12345-0@lo:101: Request processed in 120us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832069.379492:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788832069.379568:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218340096:0@lo:101: 00010000:00010000:0.0:1788832069.379582:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8600/0x998c12b283536ee4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536eeb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.379590:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8600/0x998c12b283536ee4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536eeb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832069.379671:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218340224:0@lo:256: 00000100:00100000:0.0:1788832069.379708:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.379718:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832069.379764:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218340224 00000100:00100000:2.0:1788832069.379770:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218340224 00000100:00100000:2.0:1788832069.379802:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788832069.379809:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+19:6522:x1875726218340224:12345-0@lo:256: 20000000:01000000:2.0:1788832069.379822:0:6518:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788832069.379838:0:6518:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788832069.379841:0:6518:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788832069.379923:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+19:6522:x1875726218340224:12345-0@lo:256: Request processed in 113us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832069.379939:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788832069.380007:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218340224:0@lo:256: 10000000:01000000:0.0:1788832069.380065:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788832069.380072:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8600/0x998c12b283536ee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536eeb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.380080:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8600/0x998c12b283536ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536eeb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832069.380087:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788832069.380089:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1788832069.380092:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788832069.380108:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b283536ef2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.380114:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b283536ef2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.380122:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b283536ef2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832069.380134:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218340352:0@lo:101: 00000100:00100000:0.0:1788832069.380159:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.380189:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832069.380312:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218340352 00000100:00100000:2.0:1788832069.380317:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218340352 00000100:00100000:2.0:1788832069.380349:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788832069.380356:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+19:6522:x1875726218340352:12345-0@lo:101: 00010000:00010000:2.0:1788832069.380365:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832069.380375:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c092ddc00/0x998c12b283536ef9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536ef2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832069.380391:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c092ddc00/0x998c12b283536ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536ef2 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832069.380400:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c092ddc00/0x998c12b283536ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536ef2 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832069.380406:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092ddc00, rc 0) 00000100:00100000:2.0:1788832069.380442:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+20:6522:x1875726218340352:12345-0@lo:101: Request processed in 87us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832069.380448:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788832069.380481:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218340352:0@lo:101: 00010000:00010000:0.0:1788832069.380492:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b283536ef2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536ef9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.380511:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b283536ef2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536ef9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832069.380561:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218340480:0@lo:501: 00000100:00100000:0.0:1788832069.380587:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.380609:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832069.380722:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218340480 00000100:00100000:2.0:1788832069.380727:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218340480 00000100:00100000:2.0:1788832069.380756:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788832069.380762:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+20:6522:x1875726218340480:12345-0@lo:501: 00000100:00100000:2.0:1788832069.380983:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+20:6522:x1875726218340480:12345-0@lo:501: Request processed in 220us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832069.380990:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788832069.381358:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218340480:0@lo:501: 00000100:00100000:3.0:1788832069.381398:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218340608:0@lo:503: 00000100:00100000:3.0:1788832069.381443:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832069.381484:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b2480 going to sleep for 11 seconds 00000100:00100000:2.0:1788832069.381507:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218340608 00000100:00100000:2.0:1788832069.381513:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218340608 00000100:00100000:2.0:1788832069.381557:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788832069.381564:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+20:6522:x1875726218340608:12345-0@lo:503: 00000100:00100000:2.0:1788832069.381681:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+20:6522:x1875726218340608:12345-0@lo:503: Request processed in 118us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832069.381688:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788832069.381744:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218340608:0@lo:503: 00000100:00100000:3.0:1788832069.382575:0:10085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10085:1875726218340736:0@lo:502: 00000100:00100000:3.0:1788832069.382730:0:10085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.382786:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218340736 00000100:00100000:0.0:1788832069.382793:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218340736 00000100:00100000:0.0:1788832069.382836:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788832069.382844:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+20:10085:x1875726218340736:12345-0@lo:502: 00000100:00100000:0.0:1788832069.382941:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+20:10085:x1875726218340736:12345-0@lo:502: Request processed in 98us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832069.382948:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788832069.383353:0:10085:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788832069.383373:0:10085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10085:1875726218340736:0@lo:502: 00000020:01000000:2.0:1788832069.383402:0:10085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788832069.383409:0:10085:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788832069.383416:0:10085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832069.383418:0:10085:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788832069.383423:0:10085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788832069.383426:0:10085:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:2.0:1788832069.383446:0:10085:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788832069.383449:0:10085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788832069.383465:0:10085:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9d2c3e778000) 00000020:00000080:2.0:1788832069.383487:0:10085:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1788832069.383492:0:10085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788832069.383580:0:10085:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788832069.383585:0:10085:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788832069.383592:0:10085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x998c12b283536f07 00010000:00080000:2.0:1788832069.383652:0:10085:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2c3e9eb000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1788832069.383890:0:10085:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1788832069.384013:0:10085:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788832069.384025:0:10085:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788832069.385089:0:10085:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788832069.385279:0:10085:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788832069.385416:0:10085:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788832069.385499:0:10085:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788832069.387970:0:10086:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788832069.387978:0:10086:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788832069.390584:0:10085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788832069.390600:0:10085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788832069.391331:0:10085:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788832069.391359:0:10085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x998c12b283536f0e 00000100:00080000:0.0:1788832069.391370:0:10085:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788832069.391377:0:10085:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d2c3e9eb000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788832069.391416:0:10085:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b070b9500 x1875726218340864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788832069.391489:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218340864:0@lo:8: 00000100:00100000:1.0:1788832069.391559:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788832069.391827:0:10085:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788832069.391935:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218340992:0@lo:400: 00000100:00100000:0.0:1788832069.391968:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.391987:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218341504:0@lo:400: 00000100:00100000:0.0:1788832069.392030:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.392058:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1875726218342016:0@lo:400: 00000100:00100000:0.0:1788832069.392081:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832069.392113:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218341120:0@lo:400: 00000100:00100000:0.0:1788832069.392120:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218341248:0@lo:400: 00000100:00100000:3.0:1788832069.392166:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.392167:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.392193:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218341760:0@lo:400: 00000100:00100000:3.0:1788832069.392201:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1875726218341632:0@lo:400: 00000100:00100000:3.0:1788832069.392228:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832069.392255:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218342144:0@lo:400: 00000100:00100000:3.0:1788832069.392281:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832069.392310:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218340864 00000100:00100000:3.0:1788832069.392316:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218340864 00000100:00100000:3.0:1788832069.392350:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788832069.392357:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1875726218340864:12345-0@lo:8: 00010000:00080000:3.0:1788832069.392386:0:8440:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:3.0:1788832069.392411:0:8440:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x998c12b283536f15 00002000:00100000:3.0:1788832069.392425:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9d2b064cb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788832069.392428:0:8440:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1788832069.392432:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788832069.392486:0:8440:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788832069.392695:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.392717:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788832069.392724:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218341376:0@lo:400: 00000100:00100000:0.0:1788832069.392749:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.392766:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218341888:0@lo:400: 00000100:00100000:0.0:1788832069.392786:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.392811:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218340992 00000100:00100000:0.0:1788832069.392815:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218340992 00000100:00100000:0.0:1788832069.392841:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218341504 00000100:00100000:0.0:1788832069.392849:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218341504 00000100:00100000:0.0:1788832069.392872:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218342016 00000100:00100000:0.0:1788832069.392874:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218342016 00000100:00100000:0.0:1788832069.392886:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218341248 00000100:00100000:0.0:1788832069.392889:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218341248 00000100:00100000:0.0:1788832069.392902:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218341632 00000100:00100000:0.0:1788832069.392904:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218341632 00000100:00100000:0.0:1788832069.392918:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218342144 00000100:00100000:0.0:1788832069.392920:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218342144 00000100:00100000:0.0:1788832069.392939:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788832069.392947:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218340992:12345-0@lo:400: 00000100:00100000:0.0:1788832069.393005:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218340992:12345-0@lo:400: Request processed in 58us (1035us total) trans 0 rc 0/0 00002000:00080000:3.0:1788832069.393019:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00100000:0.0:1788832069.393024:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788832069.393042:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788832069.393047:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9d2b064cb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788832069.393049:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218341504:12345-0@lo:400: 00000100:00100000:0.0:1788832069.393092:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218341504:12345-0@lo:400: Request processed in 44us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832069.393097:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788832069.393108:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788832069.393114:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875726218342016:12345-0@lo:400: 00000100:00100000:0.0:1788832069.393138:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875726218342016:12345-0@lo:400: Request processed in 25us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832069.393143:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788832069.393154:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788832069.393159:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218341248:12345-0@lo:400: 00000100:00100000:0.0:1788832069.393188:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218341248:12345-0@lo:400: Request processed in 29us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832069.393194:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788832069.393512:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788832069.393520:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875726218341632:12345-0@lo:400: 00000100:00100000:0.0:1788832069.393554:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875726218341632:12345-0@lo:400: Request processed in 36us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832069.393560:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788832069.393572:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788832069.393579:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875726218342144:12345-0@lo:400: 00000100:00100000:0.0:1788832069.393648:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875726218342144:12345-0@lo:400: Request processed in 42us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832069.393661:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788832069.393688:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788832069.393692:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788832069.393719:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b070bbb80 x1875726218340992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832069.393733:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218340992:0@lo:400: 00010000:00080000:0.0:1788832069.393745:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b070bb800 x1875726218341504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832069.393753:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218341504:0@lo:400: 00010000:00080000:0.0:1788832069.393762:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b070b8700 x1875726218342016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832069.393770:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1875726218342016:0@lo:400: 00010000:00080000:0.0:1788832069.393802:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b070b9c00 x1875726218341248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832069.393811:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218341248:0@lo:400: 00000020:01000000:0.0:1788832069.393873:0:10085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832069.393879:0:10085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832069.393882:0:10085:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788832069.393885:0:10085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832069.393889:0:10085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832069.393891:0:10085:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788832069.393894:0:10085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788832069.393896:0:10085:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788832069.393926:0:10085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10085:1875726218342272:0@lo:502: 00000100:00100000:0.0:1788832069.393971:0:10085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.394002:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218342272 00000100:00100000:0.0:1788832069.394007:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218342272 00000100:00100000:0.0:1788832069.394037:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788832069.394044:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+20:10085:x1875726218342272:12345-0@lo:502: 00000100:00100000:0.0:1788832069.394387:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+20:10085:x1875726218342272:12345-0@lo:502: Request processed in 342us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832069.394394:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788832069.394442:0:10085:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788832069.394456:0:10085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10085:1875726218342272:0@lo:502: 00000020:01000000:0.0:1788832069.394479:0:10085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832069.394483:0:10085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832069.394484:0:10085:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788832069.394488:0:10085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:0.0:1788832069.394541:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1788832069.394560:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788832069.394570:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b283536ef2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536ef9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.394580:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b283536ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536ef9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832069.394590:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788832069.394593:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d2c40623800 from 39 10000000:01000000:0.0:1788832069.394596:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788832069.396387:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9c00/0x998c12b283536f1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.396408:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9c00/0x998c12b283536f1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.396442:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9c00/0x998c12b283536f1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832069.396467:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218342400:0@lo:101: 00000100:00100000:0.0:1788832069.396531:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.396571:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788832069.396593:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218342400 00000100:00100000:0.0:1788832069.396599:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218342400 00000100:00100000:0.0:1788832069.397464:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788832069.397478:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+20:6522:x1875726218342400:12345-0@lo:101: 00010000:00010000:0.0:1788832069.397493:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832069.397511:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c36db8400/0x998c12b283536f23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536f1c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.397536:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c36db8400/0x998c12b283536f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536f1c expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.397546:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c36db8400/0x998c12b283536f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536f1c expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.397556:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c36db8400, rc 0) 00000100:00100000:0.0:1788832069.397608:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218342400:12345-0@lo:101: Request processed in 134us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832069.397615:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788832069.397692:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218342400:0@lo:101: 00010000:00010000:0.0:1788832069.397709:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9c00/0x998c12b283536f1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536f23 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.397731:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9c00/0x998c12b283536f1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536f23 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832069.397780:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875726218340864:12345-0@lo:8: Request processed in 5418us (6216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832069.397791:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788832069.397802:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218342528:0@lo:501: 00000100:00100000:3.0:1788832069.397811:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218341760 00000100:00100000:3.0:1788832069.397824:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218341760 00000100:00100000:0.0:1788832069.397835:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.397865:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832069.397871:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218341888 00000100:00100000:3.0:1788832069.397876:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218341888 00000100:00100000:0.0:1788832069.397880:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218342528 00000100:00100000:0.0:1788832069.397885:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218342528 00000100:00100000:3.0:1788832069.397898:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788832069.397908:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218341760:12345-0@lo:400: 00000100:00100000:0.0:1788832069.397915:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788832069.397924:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218342528:12345-0@lo:501: 00000100:00100000:3.0:1788832069.397956:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218341760:12345-0@lo:400: Request processed in 50us (5261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832069.397963:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788832069.397976:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788832069.397983:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218341888:12345-0@lo:400: 00000100:00100000:3.0:1788832069.398018:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218341888:12345-0@lo:400: Request processed in 35us (5230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832069.398024:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788832069.398042:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218342528:12345-0@lo:501: Request processed in 119us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832069.398047:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218341120 00000100:00100000:0.0:1788832069.398052:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788832069.398054:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218341120 00000100:00100000:3.0:1788832069.398087:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218341376 00000100:00100000:3.0:1788832069.398091:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218341376 00000100:00100000:0.0:1788832069.398092:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218342528:0@lo:501: 00000100:00100000:3.0:1788832069.398112:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788832069.398121:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218341120:12345-0@lo:400: 00000100:00100000:0.0:1788832069.398126:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218342656:0@lo:503: 00000100:00100000:0.0:1788832069.398172:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832069.398183:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218341120:12345-0@lo:400: Request processed in 63us (6023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832069.398189:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832069.398192:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788832069.398208:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788832069.398214:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218341376:12345-0@lo:400: 00000100:00100000:0.0:1788832069.398218:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218342656 00000100:00100000:0.0:1788832069.398223:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218342656 00000100:00100000:0.0:1788832069.398254:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788832069.398255:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218341376:12345-0@lo:400: Request processed in 38us (5501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832069.398263:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218342656:12345-0@lo:503: 00000100:00100000:3.0:1788832069.398264:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788832069.398313:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218341120:0@lo:400: 00010000:00080000:3.0:1788832069.398341:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b070b8e00 x1875726218341632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832069.398347:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218342656:12345-0@lo:503: Request processed in 83us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832069.398363:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1875726218341632:0@lo:400: 00000100:00100000:0.0:1788832069.398363:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00010000:00080000:3.0:1788832069.398384:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b070b9180 x1875726218342144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832069.398394:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218342144:0@lo:400: 00000100:00100000:0.0:1788832069.398416:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218342656:0@lo:503: 00000100:00080000:3.0:1788832069.398492:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788832069.398518:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218341376:0@lo:400: 00010000:00080000:3.0:1788832069.398532:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b070ba300 x1875726218341888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832069.398541:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218341888:0@lo:400: 00010000:00080000:3.0:1788832069.398552:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b070b8a80 x1875726218341760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832069.398562:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218341760:0@lo:400: 00010000:00080000:1.0:1788832069.400594:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b070b9500 x1875726218340864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788832079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832069.400610:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788832069.400693:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788832069.400704:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788832069.400711:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788832069.400715:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e9eb000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788832069.400765:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788832069.400772:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218340864:0@lo:8: 00000100:00100000:3.0:1788832069.400853:0:10088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10088:1875726218342784:0@lo:502: 00000100:00100000:3.0:1788832069.400932:0:10088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788832069.400959:0:10086:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788832069.400976:0:10088:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b29c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788832069.401029:0:10086:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 209441408298ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788832069.401036:0:10086:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788832069.401925:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218342784 00000100:00100000:1.0:1788832069.401937:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218342784 00000100:00100000:1.0:1788832069.401988:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788832069.401997:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+21:10088:x1875726218342784:12345-0@lo:502: 00000100:00100000:1.0:1788832069.402358:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+21:10088:x1875726218342784:12345-0@lo:502: Request processed in 360us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832069.402366:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788832069.402550:0:10087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182ab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10087:1875726218342912:0@lo:700: 00000100:00100000:0.0:1788832069.402589:0:10087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.402696:0:10087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788832069.402731:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218342912 00000100:00100000:1.0:1788832069.402736:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218342912 00000100:00100000:1.0:1788832069.402813:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788832069.402822:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10087:x1875726218342912:12345-0@lo:700: 00000100:00100000:1.0:1788832069.402864:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcbbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8449:1875726218343040:0@lo:700: 00000100:00100000:1.0:1788832069.402895:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832069.402913:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c07c4a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832069.402943:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218343040 00000100:00100000:1.0:1788832069.402946:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218343040 00000100:00100000:1.0:1788832069.402974:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788832069.402981:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8449:x1875726218343040:12345-0@lo:700: 00000100:00100000:3.0:1788832069.403074:0:10088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10088:1875726218342784:0@lo:502: 00000100:00100000:3.0:1788832069.403134:0:10088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10088:1875726218343168:0@lo:502: 00000100:00100000:3.0:1788832069.403178:0:10088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788832069.403188:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788832069.403206:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218343168 00000100:00100000:3.0:1788832069.403211:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218343168 00000100:00100000:3.0:1788832069.403239:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788832069.403254:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+21:10088:x1875726218343168:12345-0@lo:502: 00000100:00100000:3.0:1788832069.403340:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+21:10088:x1875726218343168:12345-0@lo:502: Request processed in 87us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832069.403347:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788832069.403388:0:10088:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832069.403400:0:10088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10088:1875726218343168:0@lo:502: 00000040:00080000:3.0:1788832069.403420:0:10088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788832069.403502:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788832069.403526:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788832069.403537:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9c00/0x998c12b283536f1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536f23 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.403549:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9c00/0x998c12b283536f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536f23 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832069.403559:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788832069.403561:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d2c40623800 from 6 10000000:01000000:0.0:1788832069.403564:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788832069.403588:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9400/0x998c12b283536f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.403597:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9400/0x998c12b283536f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.403606:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9400/0x998c12b283536f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832069.403618:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218343296:0@lo:101: 00000100:00100000:0.0:1788832069.403815:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.403833:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832069.403906:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218343296 00000100:00100000:1.0:1788832069.403911:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218343296 00000100:00100000:1.0:1788832069.403940:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788832069.403946:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218343296:12345-0@lo:101: 00010000:00010000:1.0:1788832069.403954:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832069.403966:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c390f3a00/0x998c12b283536f31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536f2a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832069.403988:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c390f3a00/0x998c12b283536f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536f2a expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832069.403999:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c390f3a00/0x998c12b283536f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536f2a expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832069.404007:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c390f3a00, rc 0) 00000100:00100000:1.0:1788832069.404039:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218343296:12345-0@lo:101: Request processed in 93us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832069.404045:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788832069.404303:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218343296:0@lo:101: 00010000:00010000:1.0:1788832069.404316:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9400/0x998c12b283536f2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536f31 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832069.404333:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9400/0x998c12b283536f2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536f31 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832069.404383:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218343424:0@lo:256: 00000100:00100000:1.0:1788832069.404413:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832069.404427:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c07c4a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788832069.404440:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218343424 00000100:00100000:1.0:1788832069.404443:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218343424 00000100:00100000:1.0:1788832069.404467:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788832069.404473:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218343424:12345-0@lo:256: 20000000:01000000:1.0:1788832069.404485:0:6519:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788832069.404500:0:6519:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788832069.404503:0:6519:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788832069.404571:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218343424:12345-0@lo:256: Request processed in 98us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832069.404577:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788832069.404603:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218343424:0@lo:256: 10000000:01000000:1.0:1788832069.404682:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788832069.404689:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9400/0x998c12b283536f2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536f31 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832069.404696:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9400/0x998c12b283536f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536f31 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832069.404704:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788832069.404706:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788832069.404709:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788832069.404727:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283536f38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832069.404734:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283536f38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832069.404743:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283536f38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832069.404754:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218343552:0@lo:101: 00000100:00100000:1.0:1788832069.404781:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832069.404798:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3d711180 going to sleep for 11 seconds 00000100:00100000:1.0:1788832069.404811:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218343552 00000100:00100000:1.0:1788832069.404815:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218343552 00000100:00100000:1.0:1788832069.404838:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788832069.404845:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218343552:12345-0@lo:101: 00010000:00010000:1.0:1788832069.404852:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832069.404861:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c390f3c00/0x998c12b283536f3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536f38 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832069.404876:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c390f3c00/0x998c12b283536f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536f38 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832069.404885:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c390f3c00/0x998c12b283536f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536f38 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832069.404891:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c390f3c00, rc 0) 00000100:00100000:1.0:1788832069.404920:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218343552:12345-0@lo:101: Request processed in 75us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832069.404926:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788832069.404963:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218343552:0@lo:101: 00010000:00010000:1.0:1788832069.404974:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283536f38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536f3f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832069.404982:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283536f38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536f3f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832069.405029:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218343680:0@lo:501: 00000100:00100000:1.0:1788832069.405067:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832069.405079:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3d711180 going to sleep for 11 seconds 00000100:00100000:3.0:1788832069.405458:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218343680 00000100:00100000:3.0:1788832069.405464:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218343680 00000100:00100000:3.0:1788832069.405505:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788832069.405513:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218343680:12345-0@lo:501: 00000100:00100000:3.0:1788832069.406098:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218343680:12345-0@lo:501: Request processed in 582us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832069.406109:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788832069.406196:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218343680:0@lo:501: 00000100:00100000:0.0:1788832069.406321:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218343808:0@lo:503: 00000100:00100000:0.0:1788832069.406370:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.406403:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fb240 going to sleep for 11 seconds 00000100:00100000:2.0:1788832069.406526:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218343808 00000100:00100000:2.0:1788832069.406532:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218343808 00000100:00100000:2.0:1788832069.406612:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788832069.406650:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218343808:12345-0@lo:503: 00000100:00100000:2.0:1788832069.406748:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218343808:12345-0@lo:503: Request processed in 127us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832069.406754:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788832069.409714:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218343808:0@lo:503: 00000004:00080000:1.0:1788832069.411378:0:7456:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788832069.411611:0:10091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10091:1875726218343936:0@lo:502: 00000100:00100000:1.0:1788832069.411857:0:10091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832069.411914:0:10091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0531c240 going to sleep for 11 seconds 00000100:00100000:0.0:1788832069.412037:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218343936 00000100:00100000:0.0:1788832069.412046:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218343936 00000100:00100000:0.0:1788832069.413283:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788832069.413298:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:10091:x1875726218343936:12345-0@lo:502: 00000100:00100000:0.0:1788832069.413459:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:10091:x1875726218343936:12345-0@lo:502: Request processed in 165us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832069.413467:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788832069.413769:0:10091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10091:1875726218343936:0@lo:502: 00000020:01000000:1.0:1788832069.413811:0:10091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788832069.413819:0:10091:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788832069.413828:0:10091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832069.413830:0:10091:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788832069.413840:0:10091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788832069.413845:0:10091:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:1.0:1788832069.413867:0:10091:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788832069.413870:0:10091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788832069.413897:0:10091:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9d2c3fd199b8) 00000020:00000080:1.0:1788832069.413924:0:10091:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1788832069.413931:0:10091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788832069.414033:0:10091:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788832069.414039:0:10091:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788832069.414052:0:10091:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x998c12b283536f4d 00010000:00080000:1.0:1788832069.414084:0:10091:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2b067ef800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.126@tcp at head 40000000:02000000:0.0:1788832069.415252:0:6532:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00010000:00010000:1.0:1788832069.416515:0:10091:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1788832069.416833:0:10091:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788832069.416850:0:10091:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788832069.417071:0:10091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788832069.417211:0:10091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788832069.417953:0:10091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788832069.418050:0:10091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788832069.418411:0:10092:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788832069.418416:0:10092:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788832069.419421:0:10091:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788832069.419434:0:10091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788832069.419472:0:10091:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788832069.419499:0:10091:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x998c12b283536f54 00000100:00080000:1.0:1788832069.419510:0:10091:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788832069.419516:0:10091:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d2b067ef800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788832069.419553:0:10091:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c3fcb9500 x1875726218344064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788832069.419586:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218344064:0@lo:8: 00000100:00100000:1.0:1788832069.419863:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788832069.419958:0:10091:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788832069.420037:0:10091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832069.420042:0:10091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832069.420044:0:10091:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788832069.420047:0:10091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832069.420051:0:10091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832069.420053:0:10091:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788832069.420056:0:10091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788832069.420058:0:10091:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788832069.420094:0:10091:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10091:1875726218344192:0@lo:502: 00000100:00100000:1.0:1788832069.420138:0:10091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832069.423233:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218344064 00000100:00100000:3.0:1788832069.423313:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218344064 00000100:00100000:3.0:1788832069.423417:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788832069.423427:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1875726218344064:12345-0@lo:8: 00010000:00080000:3.0:1788832069.423461:0:8442:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:3.0:1788832069.423518:0:8442:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x998c12b283536f5b 00002000:00100000:3.0:1788832069.423536:0:8442:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9d2c3fd3a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788832069.423540:0:8442:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788832069.423543:0:8442:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788832069.423613:0:8442:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788832069.423733:0:8442:0:(import.c:65:import_set_state_nolock()) ffff9d2c3fd3d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788832069.423828:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875726218344064:12345-0@lo:8: Request processed in 401us (3965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832069.423843:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788832069.423900:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcb9500 x1875726218344064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788832079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832069.423911:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788832069.423920:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788832069.423927:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788832069.423933:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788832069.423935:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2b067ef800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788832069.423950:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788832069.423955:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218344064:0@lo:8: 00000004:00080000:1.0:1788832069.424404:0:10092:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788832069.424457:0:10091:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0531cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832069.424746:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218344192 00000100:00100000:3.0:1788832069.424752:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218344192 00000100:00100000:3.0:1788832069.424841:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788832069.424851:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+23:10091:x1875726218344192:12345-0@lo:502: 00000100:00100000:0.0:1788832069.424973:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8449:x1875726218343040:12345-0@lo:700: Request processed in 21990us (22074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832069.424980:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+23:10091:x1875726218344192:12345-0@lo:502: Request processed in 128us (4839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832069.424987:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788832069.424994:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00010000:00080000:0.0:1788832069.425034:0:8449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcbbb80 x1875726218343040/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788832085 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832069.425065:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcbbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8449:1875726218343040:0@lo:700: 40000000:02000000:0.0:1788832069.425078:0:8449:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:1.0:1788832069.427113:0:10091:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10091:1875726218344192:0@lo:502: 00000020:01000000:1.0:1788832069.427165:0:10091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832069.427174:0:10091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832069.427176:0:10091:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788832069.427182:0:10091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000004:00080000:1.0:1788832069.429667:0:10092:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 209470043695ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788832069.429683:0:10092:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788832069.432430:0:10093:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788832069.432467:0:10093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10093:1875726218344448:0@lo:7: 00000100:00100000:1.0:1788832069.432538:0:10093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832069.432569:0:10093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0531cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832069.432745:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218344320:0@lo:13: 00000100:00100000:3.0:1788832069.432776:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832069.432819:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218344448 00000100:00100000:3.0:1788832069.432826:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218344448 00000100:00100000:3.0:1788832069.432898:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788832069.432907:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10093:x1875726218344448:12345-0@lo:7: 00000100:00100000:1.0:1788832069.433378:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218344320 00000100:00100000:1.0:1788832069.433383:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218344320 00000100:00100000:1.0:1788832069.433417:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788832069.433424:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1875726218344320:12345-0@lo:13: 00002000:00000024:1.0:1788832069.433444:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:1.0:1788832069.433497:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1875726218344320:12345-0@lo:13: Request processed in 73us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832069.433503:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:01000000:0.0:1788832069.436135:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1788832069.436181:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788832069.436193:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283536f38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536f3f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788832069.439704:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788832069.440068:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcb8e00 x1875726218344320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832069.440093:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218344320:0@lo:13: 00002000:00080000:3.0:1788832069.441762:0:8441:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788832069.441770:0:8441:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788832069.441877:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:10093:x1875726218344448:12345-0@lo:7: Request processed in 8968us (9336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832069.441886:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000004:00080000:2.0:1788832069.442155:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788832069.442387:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283536f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536f3f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832069.442414:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788832069.442417:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d2c18e319b8 from 1 10000000:01000000:0.0:1788832069.442420:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788832069.442455:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8e00/0x998c12b283536f62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.442464:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8e00/0x998c12b283536f62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832069.442474:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8e00/0x998c12b283536f62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832069.442493:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218344576:0@lo:101: 00000100:00100000:0.0:1788832069.442537:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.442576:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fb840 going to sleep for 11 seconds 00010000:00080000:1.0:1788832069.442962:0:10093:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcb9880 x1875726218344448/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788832085 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832069.442977:0:10093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10093:1875726218344448:0@lo:7: 00000004:00080000:1.0:1788832069.442988:0:10093:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788832069.443020:0:10093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10093:1875726218344704:0@lo:5: 00000100:00100000:1.0:1788832069.443048:0:10093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832069.443417:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218344576 00000100:00100000:2.0:1788832069.443425:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218344576 00000100:00100000:2.0:1788832069.443603:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788832069.443614:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218344576:12345-0@lo:101: 00010000:00010000:2.0:1788832069.443651:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832069.443671:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c092dc400/0x998c12b283536f69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536f62 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832069.443700:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c092dc400/0x998c12b283536f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536f62 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832069.443712:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c092dc400/0x998c12b283536f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536f62 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832069.443721:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dc400, rc 0) 00000100:00100000:2.0:1788832069.443771:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:6522:x1875726218344576:12345-0@lo:101: Request processed in 159us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832069.443784:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788832069.443845:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218344576:0@lo:101: 00010000:00010000:2.0:1788832069.443859:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8e00/0x998c12b283536f62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536f69 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832069.443869:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8e00/0x998c12b283536f62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536f69 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832069.443929:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218344832:0@lo:501: 00000100:00100000:2.0:1788832069.443956:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832069.443982:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0927f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832069.443995:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218344832 00000100:00100000:2.0:1788832069.443998:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218344832 00000100:00100000:2.0:1788832069.444024:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788832069.444030:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:6522:x1875726218344832:12345-0@lo:501: 00000100:00100000:2.0:1788832069.444100:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:6522:x1875726218344832:12345-0@lo:501: Request processed in 69us (142us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788832069.444106:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788832069.444134:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218344832:0@lo:501: 10000000:01000000:2.0:1788832069.444163:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788832069.444170:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8e00/0x998c12b283536f62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536f69 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832069.444179:0:10093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0531cf00 going to sleep for 11 seconds 00010000:00010000:2.0:1788832069.444180:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8e00/0x998c12b283536f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536f69 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832069.444211:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218344704 00000100:00100000:1.0:1788832069.444217:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218344704 00000100:00100000:1.0:1788832069.444381:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788832069.444389:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10093:x1875726218344704:12345-0@lo:5: 00002000:00080000:1.0:1788832069.444409:0:8440:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788832069.444412:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:2.0:1788832069.448474:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788832069.448496:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788832069.448501:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788832069.448814:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10087:x1875726218342912:12345-0@lo:700: Request processed in 45990us (46220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832069.448821:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10093:x1875726218344704:12345-0@lo:5: Request processed in 4429us (5768us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788832069.448828:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788832069.448835:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788832069.448917:0:10093:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcb9880 x1875726218344704/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788832085 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832069.448928:0:10093:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788832069.448934:0:10093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10093:1875726218344704:0@lo:5: 00000004:00080000:2.0:1788832069.448949:0:10093:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788832069.448997:0:10093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10093:1875726218344960:0@lo:700: 00000100:00100000:2.0:1788832069.449029:0:10093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832069.449057:0:10093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0927f3c0 going to sleep for 11 seconds 00010000:00080000:2.0:1788832069.449084:0:10087:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c182ab800 x1875726218342912/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788832085 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832069.449094:0:10087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182ab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10087:1875726218342912:0@lo:700: 00000100:00100000:1.0:1788832069.449193:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218344960 00000100:00100000:1.0:1788832069.449199:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218344960 00000100:00100000:1.0:1788832069.449233:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788832069.449385:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10093:x1875726218344960:12345-0@lo:700: 00000100:00100000:2.0:1788832069.461849:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832069.461873:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218345088:0@lo:13: 00000100:00100000:2.0:1788832069.461943:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788832069.461989:0:10087:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788832069.462028:0:10087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10087:1875726218345216:0@lo:7: 00000100:00100000:2.0:1788832069.462053:0:10087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832069.462080:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218345216 00000100:00100000:2.0:1788832069.462087:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218345216 00000100:00100000:2.0:1788832069.462130:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788832069.462140:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10087:x1875726218345216:12345-0@lo:7: 00000100:00100000:2.0:1788832069.462810:0:10087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0927fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788832069.462947:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218345088 00000100:00100000:1.0:1788832069.462953:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218345088 00000100:00100000:1.0:1788832069.462995:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788832069.463003:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1875726218345088:12345-0@lo:13: 00002000:00000024:1.0:1788832069.463021:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:1.0:1788832069.463079:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1875726218345088:12345-0@lo:13: Request processed in 76us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832069.463086:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788832069.463130:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f6d80 x1875726218345088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832069.463151:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218345088:0@lo:13: 00000100:00100000:0.0:1788832069.468230:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10093:x1875726218344960:12345-0@lo:700: Request processed in 18840us (19190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832069.468254:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788832069.468327:0:10093:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f4700 x1875726218344960/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788832085 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832069.468345:0:10093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10093:1875726218344960:0@lo:700: 00000004:02000040:1.0:1788832069.469749:0:10093:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00002000:00080000:2.0:1788832069.472457:0:8441:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788832069.472466:0:8441:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788832069.472565:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10087:x1875726218345216:12345-0@lo:7: Request processed in 10422us (10507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832069.472575:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788832069.473333:0:10093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcbbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10093:1875726218345344:0@lo:5: 00000100:00100000:1.0:1788832069.473381:0:10093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832069.473410:0:10093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0531c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788832069.473514:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218345344 00000100:00100000:3.0:1788832069.473524:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218345344 00000100:00100000:3.0:1788832069.473576:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788832069.473585:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10093:x1875726218345344:12345-0@lo:5: 00010000:00080000:0.0:1788832069.476751:0:10087:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc04e00 x1875726218345216/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788832085 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832069.476771:0:10087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10087:1875726218345216:0@lo:7: 00000004:00080000:0.0:1788832069.476787:0:10087:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788832069.476830:0:10087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182ab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10087:1875726218345472:0@lo:5: 00000100:00100000:0.0:1788832069.476897:0:10087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.476935:0:10087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788832069.477081:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788832069.477091:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788832069.477591:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218345472 00000100:00100000:2.0:1788832069.477599:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218345472 00000100:00100000:0.0:1788832069.480821:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788832069.480840:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10087:x1875726218345472:12345-0@lo:5: 00002000:00080000:0.0:1788832069.480872:0:10097:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788832069.480957:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:10087:x1875726218345472:12345-0@lo:5: Request processed in 123us (4059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832069.480965:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788832069.481012:0:10087:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c182ab800 x1875726218345472/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788832085 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832069.481027:0:10087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182ab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10087:1875726218345472:0@lo:5: 00000004:00080000:0.0:1788832069.481040:0:10087:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788832069.481081:0:10087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182ab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10087:1875726218345600:0@lo:5: 00000100:00100000:0.0:1788832069.481118:0:10087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832069.481147:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218345600 00000100:00100000:2.0:1788832069.481155:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218345600 00000100:00100000:0.0:1788832069.481155:0:10087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788832069.481195:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788832069.481202:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788832069.481210:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1788832069.481213:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10087:x1875726218345600:12345-0@lo:5: 00002000:00080000:2.0:1788832069.481240:0:8442:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1788832069.482803:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:10087:x1875726218345600:12345-0@lo:5: Request processed in 1597us (1680us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788832069.482812:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788832069.484771:0:10087:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c182ab800 x1875726218345600/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788832085 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832069.484791:0:10087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182ab800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10087:1875726218345600:0@lo:5: 00000004:00080000:0.0:1788832069.484807:0:10087:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788832069.484853:0:10087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10087:1875726218345728:0@lo:900: 00000100:00100000:0.0:1788832069.484903:0:10087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832069.484939:0:10087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788832069.485942:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218345728 00000100:00100000:2.0:1788832069.485952:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218345728 00000100:00100000:2.0:1788832069.486000:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788832069.486086:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10087:x1875726218345728:12345-0@lo:900: 00000100:00100000:2.0:1788832069.486158:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:10087:x1875726218345728:12345-0@lo:900: Request processed in 76us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832069.486166:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00002000:00080000:2.0:1788832069.487224:0:8440:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788832069.487243:0:8440:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00010000:00080000:3.0:1788832069.488759:0:10087:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b070b8a80 x1875726218345728/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788832085 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832069.488777:0:10087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10087:1875726218345728:0@lo:900: 00000100:00100000:2.0:1788832069.490557:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:10093:x1875726218345344:12345-0@lo:5: Request processed in 16967us (17171us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788832069.490579:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788832069.490585:0:10093:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcbbb80 x1875726218345344/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788832085 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832069.490609:0:10093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcbbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10093:1875726218345344:0@lo:5: 00000004:00080000:0.0:1788832069.490649:0:10093:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:3.0:1788832070.102862:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832070.360511:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788832070.361328:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218345856:0@lo:13: 00000100:00100000:3.0:1788832070.361533:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832070.361942:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218345856 00000100:00100000:1.0:1788832070.361951:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218345856 00000100:00100000:1.0:1788832070.362050:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788832070.362061:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218345856:12345-0@lo:13: 00002000:00000024:1.0:1788832070.362097:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832070.362161:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218345856:12345-0@lo:13: Request processed in 102us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832070.362170:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788832070.362265:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc06300 x1875726218345856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832070.362286:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218345856:0@lo:13: 00000100:00100000:3.0:1788832070.867944:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832070.871190:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202569088 00000100:00100000:2.0:1788832070.871208:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202569088 00000100:00100000:2.0:1788832070.871274:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 179 00000100:00100000:2.0:1788832070.871284:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2392:x1875726202569088:12345-192.168.203.26@tcp:250: 00010000:00080000:2.0:1788832070.871315:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 229a6744-cc0e-4765-812a-1d39bc7df2da@192.168.203.26@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:2.0:1788832070.871346:0:6519:0:(genops.c:1385:class_connect()) connect: client 229a6744-cc0e-4765-812a-1d39bc7df2da, cookie 0x998c12b283536f70 00000100:00080000:2.0:1788832070.871489:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e71c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788832070.872019:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832070.872038:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218345984:0@lo:13: 00000100:00100000:2.0:1788832070.872045:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+5:2392:x1875726202569088:12345-192.168.203.26@tcp:250: Request processed in 761us (4150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832070.872053:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 179 00000100:00100000:3.0:1788832070.872104:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832070.872150:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218345984 00000100:00100000:2.0:1788832070.872155:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218345984 00000100:00100000:2.0:1788832070.872238:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788832070.872248:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218345984:12345-0@lo:13: 00002000:00000024:2.0:1788832070.872266:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788832070.872315:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218345984:12345-0@lo:13: Request processed in 69us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832070.872321:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788832070.872392:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f4700 x1875726218345984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832070.872409:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218345984:0@lo:13: 00000100:00100000:2.0:1788832070.876949:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832070.883371:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202568960 00000100:00100000:3.0:1788832070.883388:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202568960 00000100:00100000:3.0:1788832070.883531:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 180 00000100:00100000:3.0:1788832070.883542:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+5:6154:x1875726202568960:12345-192.168.203.26@tcp:101: 00010000:00010000:3.0:1788832070.883576:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832070.883598:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c421d3000/0x998c12b283536f77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc044e3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832070.883666:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d3000/0x998c12b283536f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc044e3 expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832070.883680:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c421d3000/0x998c12b283536f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc044e3 expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832070.883690:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d3000, rc 0) 00000100:00100000:3.0:1788832070.883830:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+6:6154:x1875726202568960:12345-192.168.203.26@tcp:101: Request processed in 289us (6956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832070.883838:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 180 00000100:00100000:1.0:1788832070.892401:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832070.892542:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202569216 00000100:00100000:2.0:1788832070.892552:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202569216 00000100:00100000:2.0:1788832070.892607:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 181 00000100:00100000:2.0:1788832070.892617:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+6:6154:x1875726202569216:12345-192.168.203.26@tcp:501: 00000100:00100000:2.0:1788832070.894024:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+6:6154:x1875726202569216:12345-192.168.203.26@tcp:501: Request processed in 1402us (1626us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788832070.894053:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 181 00000100:00100000:2.0:1788832070.900159:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832070.900366:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202569344 00000100:00100000:3.0:1788832070.900377:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202569344 00000100:00100000:3.0:1788832070.900438:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 182 00000100:00100000:3.0:1788832070.900449:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+6:6154:x1875726202569344:12345-192.168.203.26@tcp:101: 00010000:00010000:3.0:1788832070.900466:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832070.900485:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c421d2a00/0x998c12b283536f7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc044ea expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832070.900513:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d2a00/0x998c12b283536f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc044ea expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832070.900524:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c421d2a00/0x998c12b283536f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc044ea expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832070.900534:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2a00, rc 0) 00000100:00100000:3.0:1788832070.900615:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+7:6154:x1875726202569344:12345-192.168.203.26@tcp:101: Request processed in 167us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832070.900658:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 182 00000100:00100000:0.0:1788832070.905803:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832070.908473:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202569472 00000100:00100000:2.0:1788832070.908487:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202569472 00000100:00100000:2.0:1788832070.908616:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 183 00000100:00100000:2.0:1788832070.908651:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+7:6154:x1875726202569472:12345-192.168.203.26@tcp:501: 00000100:00100000:2.0:1788832070.908840:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+8:6154:x1875726202569472:12345-192.168.203.26@tcp:501: Request processed in 191us (3045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832070.908849:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 183 00000100:00100000:2.0:1788832070.915280:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832070.915732:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202569600 00000100:00100000:1.0:1788832070.915742:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202569600 00000100:00100000:1.0:1788832070.915944:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 184 00000100:00100000:1.0:1788832070.915958:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+8:6154:x1875726202569600:12345-192.168.203.26@tcp:503: 00000100:00100000:1.0:1788832070.916224:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+8:6154:x1875726202569600:12345-192.168.203.26@tcp:503: Request processed in 268us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832070.916232:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 184 00000100:00100000:0.0:1788832070.923720:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832070.931518:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202569728 00000100:00100000:2.0:1788832070.931535:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202569728 00000100:00100000:2.0:1788832070.931710:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 185 00000100:00100000:2.0:1788832070.931723:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+8:6174:x1875726202569728:12345-192.168.203.26@tcp:502: 00000100:00100000:2.0:1788832070.931916:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+8:6174:x1875726202569728:12345-192.168.203.26@tcp:502: Request processed in 195us (8205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832070.931924:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 185 00000100:00100000:0.0:1788832070.992381:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832070.992587:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202569856 00000100:00100000:3.0:1788832070.992599:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202569856 00000100:00100000:3.0:1788832070.992708:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 186 00000100:00100000:3.0:1788832070.992720:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+8:6174:x1875726202569856:12345-192.168.203.26@tcp:502: 00000100:00100000:3.0:1788832070.992904:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+8:6174:x1875726202569856:12345-192.168.203.26@tcp:502: Request processed in 186us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832070.992913:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 186 00000100:00100000:3.0:1788832071.007817:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832071.007889:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202569984 00000100:00100000:2.0:1788832071.007899:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202569984 00000100:00100000:2.0:1788832071.007959:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 187 00000100:00100000:2.0:1788832071.007969:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+8:6154:x1875726202569984:12345-192.168.203.26@tcp:101: 00010000:00010000:2.0:1788832071.007986:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832071.008004:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c092dce00/0x998c12b283536f85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0451b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832071.008032:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c092dce00/0x998c12b283536f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0451b expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832071.008058:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c092dce00/0x998c12b283536f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0451b expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832071.008068:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dce00, rc 0) 00000100:00100000:2.0:1788832071.008143:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+9:6154:x1875726202569984:12345-192.168.203.26@tcp:101: Request processed in 175us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832071.008150:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 187 00000100:00100000:0.0:1788832071.019580:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832071.019901:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202570112 00000100:00100000:1.0:1788832071.019912:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202570112 00000100:00100000:1.0:1788832071.020008:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 188 00000100:00100000:1.0:1788832071.020018:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+9:6154:x1875726202570112:12345-192.168.203.26@tcp:256: 20000000:01000000:1.0:1788832071.020042:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788832071.020062:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788832071.020070:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788832071.020073:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788832071.020076:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788832071.020078:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788832071.022899:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+9:6154:x1875726202570112:12345-192.168.203.26@tcp:256: Request processed in 2873us (3324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832071.022912:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 188 00000100:00100000:3.0:1788832071.030111:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832071.030494:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202570240 00000100:00100000:2.0:1788832071.030505:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202570240 00000100:00100000:2.0:1788832071.030609:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 189 00000100:00100000:2.0:1788832071.030660:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+9:6154:x1875726202570240:12345-192.168.203.26@tcp:101: 00010000:00010000:2.0:1788832071.030690:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832071.030710:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c092dd200/0x998c12b283536f8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04522 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832071.030738:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c092dd200/0x998c12b283536f8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04522 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832071.030749:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c092dd200/0x998c12b283536f8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04522 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832071.030757:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dd200, rc 0) 00000100:00100000:2.0:1788832071.030812:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+10:6154:x1875726202570240:12345-192.168.203.26@tcp:101: Request processed in 194us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832071.030819:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 189 00000100:00100000:0.0:1788832071.034510:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832071.034665:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202570368 00000100:00100000:1.0:1788832071.034674:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202570368 00000100:00100000:1.0:1788832071.034732:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 190 00000100:00100000:1.0:1788832071.034742:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+10:6154:x1875726202570368:12345-192.168.203.26@tcp:501: 00000100:00100000:1.0:1788832071.034906:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+10:6154:x1875726202570368:12345-192.168.203.26@tcp:501: Request processed in 165us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832071.034913:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 190 00000100:00100000:1.0:1788832071.040809:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832071.042226:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202570496 00000100:00100000:2.0:1788832071.042240:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202570496 00000100:00100000:2.0:1788832071.042341:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 191 00000100:00100000:2.0:1788832071.042353:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+10:6154:x1875726202570496:12345-192.168.203.26@tcp:503: 00000100:00100000:2.0:1788832071.042528:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+10:6154:x1875726202570496:12345-192.168.203.26@tcp:503: Request processed in 177us (1729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832071.042536:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 191 00000100:00100000:2.0:1788832071.046200:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832071.046361:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202570624 00000100:00100000:0.0:1788832071.046371:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202570624 00000100:00100000:0.0:1788832071.046429:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 192 00000100:00100000:0.0:1788832071.046440:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+10:6181:x1875726202570624:12345-192.168.203.26@tcp:502: 00000100:00100000:0.0:1788832071.046867:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+10:6181:x1875726202570624:12345-192.168.203.26@tcp:502: Request processed in 428us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832071.046884:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 192 00000100:00100000:0.0:1788832071.057907:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832071.058006:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202570752 00000100:00100000:1.0:1788832071.058016:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202570752 00000100:00100000:1.0:1788832071.058077:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 193 00000100:00100000:1.0:1788832071.058087:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+10:6181:x1875726202570752:12345-192.168.203.26@tcp:502: 00000100:00100000:1.0:1788832071.058256:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+10:6181:x1875726202570752:12345-192.168.203.26@tcp:502: Request processed in 170us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832071.058264:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 193 00000100:00100000:1.0:1788832071.064606:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832071.064701:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832071.064840:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202570880 00000100:00100000:2.0:1788832071.064850:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202570880 00000100:00100000:2.0:1788832071.064892:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202571136 00000100:00100000:2.0:1788832071.064895:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202571136 00000100:00100000:2.0:1788832071.064925:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:2.0:1788832071.064934:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875726202570880:12345-192.168.203.26@tcp:38: 00010000:00080000:2.0:1788832071.064961:0:6525:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:2.0:1788832071.065015:0:6525:0:(genops.c:1385:class_connect()) connect: client 352fff76-09db-42cd-818a-16e788a01abb, cookie 0x998c12b283536f93 00000004:00100000:2.0:1788832071.065042:0:6525:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788832071.065366:0:6525:0:(import.c:65:import_set_state_nolock()) ffff9d2b057da000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832071.065430:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+6:2392:x1875726202570880:12345-192.168.203.26@tcp:38: Request processed in 495us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832071.065438:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:2.0:1788832071.065458:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:2.0:1788832071.065462:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875726202571136:12345-192.168.203.26@tcp:38: 00010000:00080000:2.0:1788832071.066667:0:6525:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:2.0:1788832071.066730:0:6525:0:(genops.c:1385:class_connect()) connect: client 352fff76-09db-42cd-818a-16e788a01abb, cookie 0x998c12b283536f9a 00000004:00100000:2.0:1788832071.066757:0:6525:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788832071.066960:0:6525:0:(import.c:65:import_set_state_nolock()) ffff9d2c3fc33000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832071.067016:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+6:2392:x1875726202571136:12345-192.168.203.26@tcp:38: Request processed in 1551us (2314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832071.067033:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 8 00010000:00010000:1.0:1788832071.128559:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832072.073879:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832072.073922:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832072.073962:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832072.073976:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202571392 00000100:00100000:2.0:1788832072.073986:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202571392 00000100:00080000:0.0:1788832072.074027:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832072.074044:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202571008 00000100:00100000:2.0:1788832072.074047:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202571008 00000100:00100000:2.0:1788832072.074062:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202571264 00000100:00100000:2.0:1788832072.074064:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202571264 00000100:00100000:2.0:1788832072.074094:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:2.0:1788832072.074105:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+7:6154:x1875726202571392:12345-192.168.203.26@tcp:41: 00000100:00080000:0.0:1788832072.074128:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:2.0:1788832072.074143:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788832072.074174:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:3.0:1788832072.074183:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+7:0:x1875726202571008:12345-192.168.203.26@tcp:41: 00000004:00000024:3.0:1788832072.074195:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788832072.074209:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+7:6154:x1875726202571392:12345-192.168.203.26@tcp:41: Request processed in 106us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832072.074216:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:3.0:1788832072.074217:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+7:0:x1875726202571008:12345-192.168.203.26@tcp:41: Request processed in 36us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832072.074222:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:3.0:1788832072.074233:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:3.0:1788832072.074657:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+6:0:x1875726202571264:12345-192.168.203.26@tcp:41: 00000004:00000024:3.0:1788832072.074679:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788832072.074719:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+6:0:x1875726202571264:12345-192.168.203.26@tcp:41: Request processed in 479us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832072.080802:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832072.081105:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202571520 00000100:00100000:2.0:1788832072.081116:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202571520 00000100:00100000:2.0:1788832072.081187:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:2.0:1788832072.081197:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+6:6154:x1875726202571520:12345-192.168.203.26@tcp:40: 00000100:00100000:2.0:1788832072.081286:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+6:6154:x1875726202571520:12345-192.168.203.26@tcp:40: Request processed in 90us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832072.081293:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:3.0:1788832072.081367:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:0.0:1788832072.093016:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832072.093116:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832072.096217:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202571648 00000100:00100000:2.0:1788832072.096235:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202571648 00000100:00100000:2.0:1788832072.096352:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202571776 00000100:00100000:2.0:1788832072.096356:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202571776 00000100:00100000:1.0:1788832072.099102:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832072.099144:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832072.099184:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202571904 00000100:00100000:1.0:1788832072.099192:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202571904 00000100:00100000:1.0:1788832072.099234:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:1.0:1788832072.099245:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:352fff76-09db-42cd-818a-16e788a01abb+6:6154:x1875726202571904:12345-192.168.203.26@tcp:900: 00000100:00100000:1.0:1788832072.099319:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:352fff76-09db-42cd-818a-16e788a01abb+6:6154:x1875726202571904:12345-192.168.203.26@tcp:900: Request processed in 76us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832072.099325:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:1.0:1788832072.099470:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202572032 00000100:00100000:1.0:1788832072.099475:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202572032 00000100:00100000:1.0:1788832072.099503:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 194 00000100:00100000:1.0:1788832072.099509:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+10:2396:x1875726202572032:12345-192.168.203.26@tcp:400: 00000100:00100000:1.0:1788832072.099751:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+10:2396:x1875726202572032:12345-192.168.203.26@tcp:400: Request processed in 240us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832072.099759:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 194 00000100:00100000:3.0:1788832072.100052:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:3.0:1788832072.100068:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875726202571648:12345-192.168.203.26@tcp:8: 00010000:00080000:3.0:1788832072.100097:0:8442:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:3.0:1788832072.100132:0:8442:0:(genops.c:1385:class_connect()) connect: client 352fff76-09db-42cd-818a-16e788a01abb, cookie 0x998c12b283536fa1 00002000:00100000:3.0:1788832072.100144:0:8442:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 352fff76-09db-42cd-818a-16e788a01abb/ffff9d2c3fd3d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788832072.100168:0:8442:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788832072.100329:0:8442:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788832072.101568:0:8442:0:(import.c:65:import_set_state_nolock()) ffff9d2c3fd3f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788832072.101664:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+6:2392:x1875726202571648:12345-192.168.203.26@tcp:8: Request processed in 1593us (8654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832072.101674:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:3.0:1788832072.101705:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:3.0:1788832072.101710:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875726202571776:12345-192.168.203.26@tcp:8: 00010000:00080000:3.0:1788832072.101734:0:8442:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:3.0:1788832072.101758:0:8442:0:(genops.c:1385:class_connect()) connect: client 352fff76-09db-42cd-818a-16e788a01abb, cookie 0x998c12b283536fa8 00002000:00100000:3.0:1788832072.101768:0:8442:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 352fff76-09db-42cd-818a-16e788a01abb/ffff9d2c3fd3c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788832072.101783:0:8442:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788832072.102546:0:8442:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788832072.102578:0:8442:0:(import.c:65:import_set_state_nolock()) ffff9d2c3fd39000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788832072.102645:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+6:2392:x1875726202571776:12345-192.168.203.26@tcp:8: Request processed in 907us (9503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832072.102654:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:1.0:1788832072.107041:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832072.107609:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202572160 00000100:00100000:2.0:1788832072.107652:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202572160 00000100:00100000:2.0:1788832072.107708:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:2.0:1788832072.107719:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+6:6154:x1875726202572160:12345-192.168.203.26@tcp:33: 00000004:00080000:1.0:1788832072.144040:0:6528:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 36219us 00010000:00010000:3.0:1788832072.151386:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:2.0:1788832072.170494:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788832072.170693:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+6:6154:x1875726202572160:12345-192.168.203.26@tcp:33: Request processed in 62961us (63648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832072.170705:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:1.0:1788832072.452679:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832072.452762:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202572288 00000100:00100000:2.0:1788832072.452772:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202572288 00000100:00100000:2.0:1788832072.452841:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:2.0:1788832072.452851:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+6:6199:x1875726202572288:12345-192.168.203.26@tcp:101: 00010000:00010000:2.0:1788832072.452880:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832072.455709:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dde00/0x998c12b283536faf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04553 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832072.456392:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b283536fb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832072.456409:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b283536fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832072.456426:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b283536fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832072.456471:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788832072.456474:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788832072.456489:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b283536fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832072.456517:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dde00/0x998c12b283536faf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04553 expref: 8 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832072.456536:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b283536fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04553 expref: 7 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832072.456558:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c36bdb000) 00010000:00010000:2.0:1788832072.456562:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788832072.456566:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dc000, rc 0) 00000100:00100000:2.0:1788832072.457114:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+7:6199:x1875726202572288:12345-192.168.203.26@tcp:101: Request processed in 4261us (4440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832072.457123:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 13 00010000:00010000:1.0:1788832073.174860:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832073.431403:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832073.431426:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218346112:0@lo:41: 00000100:00100000:1.0:1788832073.431503:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832073.431762:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218346112 00000100:00100000:3.0:1788832073.431770:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218346112 00000100:00100000:3.0:1788832073.431835:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788832073.431843:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218346112:12345-0@lo:41: 00000004:00000024:3.0:1788832073.431873:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788832073.431931:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218346112:12345-0@lo:41: Request processed in 87us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832073.431939:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788832073.432053:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218346112:0@lo:41: 00000100:00100000:2.0:1788832073.943018:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218346240:0@lo:41: 00000100:00100000:2.0:1788832073.943105:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832073.943847:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218346240 00000100:00100000:0.0:1788832073.943856:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218346240 00000100:00100000:0.0:1788832073.943913:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788832073.943932:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218346240:12345-0@lo:41: 00000004:00000024:0.0:1788832073.943968:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788832073.944032:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218346240:12345-0@lo:41: Request processed in 102us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832073.944040:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788832073.944196:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218346240:0@lo:41: 00010000:00010000:3.0:1788832074.198936:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832074.454985:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218346368:0@lo:400: 00000100:00100000:0.0:1788832074.455069:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832074.455125:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218346880:0@lo:400: 00000100:00100000:0.0:1788832074.455157:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832074.455177:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218347392:0@lo:400: 00000100:00100000:0.0:1788832074.455199:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832074.455214:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218347904:0@lo:400: 00000100:00100000:0.0:1788832074.455234:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832074.455258:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788832074.455264:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218346496:0@lo:400: 00000100:00100000:0.0:1788832074.455289:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832074.455304:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218347008:0@lo:400: 00000100:00100000:0.0:1788832074.455324:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832074.455352:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1875726218347520:0@lo:400: 00000100:00100000:0.0:1788832074.455372:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832074.455399:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218347392 00000100:00100000:0.0:1788832074.455406:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218347392 00000100:00100000:0.0:1788832074.455456:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218347904 00000100:00100000:0.0:1788832074.455459:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218347904 00000100:00100000:0.0:1788832074.455476:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788832074.455483:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218347392:12345-0@lo:400: 00000100:00100000:0.0:1788832074.455537:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218347392:12345-0@lo:400: Request processed in 54us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832074.455543:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788832074.455557:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788832074.455563:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1875726218347904:12345-0@lo:400: 00000100:00100000:0.0:1788832074.455587:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1875726218347904:12345-0@lo:400: Request processed in 25us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832074.455593:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788832074.455617:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788832074.455654:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788832074.455665:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218346496 00000100:00100000:0.0:1788832074.455669:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218346496 00000100:00100000:0.0:1788832074.455694:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218347008 00000100:00100000:0.0:1788832074.455696:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218347008 00000100:00100000:0.0:1788832074.455710:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218347520 00000100:00100000:0.0:1788832074.455712:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218347520 00000100:00100000:0.0:1788832074.455724:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788832074.455730:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218346496:12345-0@lo:400: 00000100:00100000:0.0:1788832074.455760:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218346496:12345-0@lo:400: Request processed in 30us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832074.455766:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788832074.455785:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788832074.455791:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218347008:12345-0@lo:400: 00000100:00100000:0.0:1788832074.455819:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218347008:12345-0@lo:400: Request processed in 28us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832074.455824:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788832074.455836:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788832074.455842:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875726218347520:12345-0@lo:400: 00000100:00100000:0.0:1788832074.455865:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875726218347520:12345-0@lo:400: Request processed in 24us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832074.455870:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1788832074.455887:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832074.455913:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218346496:0@lo:400: 00000100:00100000:0.0:1788832074.455923:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218347008:0@lo:400: 00000100:00100000:0.0:1788832074.455930:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1875726218347520:0@lo:400: 00010000:00080000:0.0:1788832074.455941:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36d0f480 x1875726218347392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832074.455950:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218347392:0@lo:400: 00010000:00080000:0.0:1788832074.455958:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36d0c380 x1875726218347904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832074.455966:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218347904:0@lo:400: 00000100:00100000:1.0:1788832074.456120:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218346368 00000100:00100000:1.0:1788832074.456125:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218346368 00000100:00100000:1.0:1788832074.456167:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788832074.456175:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218346368:12345-0@lo:400: 00000100:00100000:1.0:1788832074.456222:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218346368:12345-0@lo:400: Request processed in 48us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832074.456228:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788832074.456352:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218346624:0@lo:400: 00000100:00100000:2.0:1788832074.456384:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832074.456407:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218347136:0@lo:400: 00000100:00100000:2.0:1788832074.456428:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832074.456445:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218347648:0@lo:400: 00000100:00100000:2.0:1788832074.456469:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832074.456488:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788832074.456495:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218346752:0@lo:400: 00000100:00100000:2.0:1788832074.456528:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832074.456539:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218347264:0@lo:400: 00000100:00100000:2.0:1788832074.456557:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832074.456574:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218347776:0@lo:400: 00000100:00100000:2.0:1788832074.456593:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832074.456645:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218347264 00000100:00100000:2.0:1788832074.456657:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218347264 00000100:00100000:2.0:1788832074.456687:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218347776 00000100:00100000:2.0:1788832074.456690:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218347776 00000100:00100000:2.0:1788832074.456704:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788832074.456710:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218347264:12345-0@lo:400: 00000100:00100000:2.0:1788832074.456746:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218347264:12345-0@lo:400: Request processed in 35us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832074.456752:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788832074.456763:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788832074.456769:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3653:x1875726218347776:12345-0@lo:400: 00000100:00100000:2.0:1788832074.456793:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3653:x1875726218347776:12345-0@lo:400: Request processed in 25us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832074.456799:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788832074.456817:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218347136 00000100:00100000:2.0:1788832074.456820:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218347136 00000100:00100000:2.0:1788832074.456836:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218347648 00000100:00100000:2.0:1788832074.456838:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218347648 00000100:00100000:2.0:1788832074.456848:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218346752 00000100:00100000:2.0:1788832074.456850:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218346752 00000100:00100000:2.0:1788832074.456861:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788832074.456867:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218347136:12345-0@lo:400: 00000100:00100000:2.0:1788832074.456895:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218347136:12345-0@lo:400: Request processed in 28us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832074.456901:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788832074.456912:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788832074.456917:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218347648:12345-0@lo:400: 00000100:00100000:2.0:1788832074.456941:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218347648:12345-0@lo:400: Request processed in 25us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832074.456955:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788832074.456967:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788832074.456973:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218346752:12345-0@lo:400: 00000100:00100000:2.0:1788832074.456998:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218346752:12345-0@lo:400: Request processed in 26us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832074.457004:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1788832074.457019:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788832074.457022:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788832074.457024:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832074.457036:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218346880 00000100:00100000:2.0:1788832074.457039:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218346880 00000100:00100000:2.0:1788832074.457057:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218346624 00000100:00100000:2.0:1788832074.457060:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218346624 00000100:00100000:2.0:1788832074.457071:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788832074.457077:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218346880:12345-0@lo:400: 00000100:00100000:2.0:1788832074.457108:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218346880:12345-0@lo:400: Request processed in 31us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832074.457113:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788832074.457124:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788832074.457130:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218346624:12345-0@lo:400: 00000100:00100000:2.0:1788832074.457156:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218346624:12345-0@lo:400: Request processed in 26us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832074.457161:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788832074.457209:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218346752:0@lo:400: 00010000:00080000:2.0:1788832074.457221:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36d0d880 x1875726218347264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832074.457243:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218347264:0@lo:400: 00010000:00080000:2.0:1788832074.457256:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36d0e680 x1875726218347776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832074.457264:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218347776:0@lo:400: 00000100:00100000:2.0:1788832074.457273:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218346624:0@lo:400: 00010000:00080000:2.0:1788832074.457282:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36d0d180 x1875726218347136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832074.457289:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218347136:0@lo:400: 00010000:00080000:2.0:1788832074.457298:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36d0ed80 x1875726218347648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832074.457306:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218347648:0@lo:400: 00000100:00100000:0.0:1788832074.458288:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218346368:0@lo:400: 00000100:00100000:0.0:1788832074.458303:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218346880:0@lo:400: 00000100:00100000:3.0:1788832074.458469:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218348032:0@lo:13: 00000100:00100000:3.0:1788832074.458528:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832074.458674:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218348032 00000100:00100000:1.0:1788832074.458680:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218348032 00000100:00100000:1.0:1788832074.458726:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788832074.458734:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875726218348032:12345-0@lo:13: 00002000:00000024:1.0:1788832074.458758:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832074.458799:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875726218348032:12345-0@lo:13: Request processed in 65us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832074.458805:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788832074.459094:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36d0c000 x1875726218348032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832074.459111:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218348032:0@lo:13: 00000100:00100000:3.0:1788832074.792699:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832074.792801:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202572416 00000100:00100000:2.0:1788832074.792812:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202572416 00000100:00100000:2.0:1788832074.792884:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:2.0:1788832074.792895:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+7:6251:x1875726202572416:12345-192.168.203.26@tcp:41: 00000004:00000024:2.0:1788832074.792934:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788832074.793008:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+7:6251:x1875726202572416:12345-192.168.203.26@tcp:41: Request processed in 114us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832074.793016:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00080000:0.0:1788832074.793163:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832074.798100:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832074.798358:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202572544 00000100:00100000:2.0:1788832074.798368:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202572544 00000100:00100000:2.0:1788832074.798448:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:2.0:1788832074.798458:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+6:6251:x1875726202572544:12345-192.168.203.26@tcp:41: 00000004:00000024:2.0:1788832074.798518:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788832074.798593:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+6:6251:x1875726202572544:12345-192.168.203.26@tcp:41: Request processed in 136us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832074.798609:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00080000:0.0:1788832074.798712:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788832074.812434:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832074.812714:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202572672 00000100:00100000:3.0:1788832074.812724:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202572672 00000100:00100000:3.0:1788832074.812816:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:3.0:1788832074.812826:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:352fff76-09db-42cd-818a-16e788a01abb+6:6251:x1875726202572672:12345-192.168.203.26@tcp:13: 00002000:00000024:3.0:1788832074.812869:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832074.812940:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:352fff76-09db-42cd-818a-16e788a01abb+6:6251:x1875726202572672:12345-192.168.203.26@tcp:13: Request processed in 115us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832074.812948:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00080000:0.0:1788832074.813110:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832074.819070:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832074.819156:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202572800 00000100:00100000:3.0:1788832074.819167:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202572800 00000100:00080000:0.0:1788832074.819294:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788832074.819560:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:3.0:1788832074.819571:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:352fff76-09db-42cd-818a-16e788a01abb+6:6251:x1875726202572800:12345-192.168.203.26@tcp:13: 00002000:00000024:3.0:1788832074.819595:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832074.819713:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:352fff76-09db-42cd-818a-16e788a01abb+6:6251:x1875726202572800:12345-192.168.203.26@tcp:13: Request processed in 143us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832074.819719:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:2.0:1788832074.970309:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218348160:0@lo:13: 00000100:00100000:2.0:1788832074.970384:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832074.970559:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218348160 00000100:00100000:3.0:1788832074.970568:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218348160 00000100:00100000:3.0:1788832074.970645:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788832074.970656:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1875726218348160:12345-0@lo:13: 00002000:00000024:3.0:1788832074.970678:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832074.970732:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1875726218348160:12345-0@lo:13: Request processed in 78us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832074.970740:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788832074.971015:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f1880 x1875726218348160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832074.971035:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218348160:0@lo:13: 00000001:00100000:1.0:1788832074.987886:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 352fff76-09db-42cd-818a-16e788a01abb 00000001:00080000:1.0:1788832074.987924:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:1.0:1788832074.987942:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1788832075.223315:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832075.482561:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218348288:0@lo:13: 00000100:00100000:0.0:1788832075.482688:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832075.483062:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218348288 00000100:00100000:2.0:1788832075.483071:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218348288 00000100:00100000:2.0:1788832075.483132:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788832075.483143:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218348288:12345-0@lo:13: 00002000:00000024:2.0:1788832075.483167:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788832075.483226:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218348288:12345-0@lo:13: Request processed in 85us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832075.483234:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788832075.483375:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc04000 x1875726218348288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832075.483407:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218348288:0@lo:13: 00000100:00100000:2.0:1788832075.995507:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218348416:0@lo:13: 00000100:00100000:2.0:1788832075.995585:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832075.999504:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218348416 00000100:00100000:2.0:1788832075.999529:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218348416 00000100:00100000:2.0:1788832075.999587:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788832076.001648:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218348416:12345-0@lo:13: 00002000:00000024:2.0:1788832076.001722:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832076.007550:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218348416:12345-0@lo:13: Request processed in 7943us (11954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832076.007565:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788832076.015739:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36d0dc00 x1875726218348416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832076.015781:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218348416:0@lo:13: 00010000:00010000:0.0:1788832076.251810:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788832077.017288:0:6504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 352fff76-09db-42cd-818a-16e788a01abb 00000001:00100000:1.0:1788832077.017793:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 352fff76-09db-42cd-818a-16e788a01abb 00010000:00010000:1.0:1788832077.271780:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832077.531524:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832077.531579:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832077.531636:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832077.531647:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202572928 00000100:00100000:0.0:1788832077.531660:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202572928 00000100:00100000:1.0:1788832077.531669:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832077.531697:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832077.531733:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202573184 00000100:00100000:1.0:1788832077.531738:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202573184 00000100:00100000:1.0:1788832077.531802:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202573056 00000100:00100000:1.0:1788832077.531806:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202573056 00000100:00100000:1.0:1788832077.531830:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:0.0:1788832077.531831:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 196 00000100:00100000:1.0:1788832077.531842:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202573184:12345-192.168.203.26@tcp:400: 00000100:00100000:0.0:1788832077.531842:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+10:2395:x1875726202572928:12345-192.168.203.26@tcp:400: 00000100:00100000:0.0:1788832077.531944:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+10:2395:x1875726202572928:12345-192.168.203.26@tcp:400: Request processed in 105us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832077.531952:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 196 00000100:00080000:0.0:1788832077.532886:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788832077.532893:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788832077.532910:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202573440 00000100:00100000:0.0:1788832077.532918:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202573440 00000100:00100000:0.0:1788832077.533133:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202573312 00000100:00100000:0.0:1788832077.533138:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202573312 00000100:00100000:0.0:1788832077.533175:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:0.0:1788832077.533185:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202573440:12345-192.168.203.26@tcp:400: 00000100:00100000:1.0:1788832077.533307:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202573184:12345-192.168.203.26@tcp:400: Request processed in 1465us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832077.533316:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:1.0:1788832077.533343:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:1.0:1788832077.533354:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+6:2395:x1875726202573056:12345-192.168.203.26@tcp:400: 00000100:00100000:1.0:1788832077.533384:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+6:2395:x1875726202573056:12345-192.168.203.26@tcp:400: Request processed in 34us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832077.533390:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:1.0:1788832077.533424:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:1.0:1788832077.533432:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:352fff76-09db-42cd-818a-16e788a01abb+6:2395:x1875726202573312:12345-192.168.203.26@tcp:400: 00000100:00100000:1.0:1788832077.533458:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:352fff76-09db-42cd-818a-16e788a01abb+6:2395:x1875726202573312:12345-192.168.203.26@tcp:400: Request processed in 28us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832077.533465:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00080000:1.0:1788832077.533508:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788832077.533512:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788832077.535831:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202573440:12345-192.168.203.26@tcp:400: Request processed in 2632us (4179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832077.535870:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 9 00000001:02000400:1.0:1788832077.687202:0:10189:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1788832078.047078:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 352fff76-09db-42cd-818a-16e788a01abb 00010000:00010000:3.0:1788832078.310260:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832078.550969:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218348544:0@lo:41: 00000100:00100000:1.0:1788832078.551046:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832078.551171:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218348544 00000100:00100000:3.0:1788832078.551179:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218348544 00000100:00100000:3.0:1788832078.551227:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788832078.551237:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218348544:12345-0@lo:41: 00000004:00000024:3.0:1788832078.551270:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788832078.551320:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218348544:12345-0@lo:41: Request processed in 84us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832078.551327:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788832078.551512:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218348544:0@lo:41: 00000100:00100000:3.0:1788832079.064333:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788832079.064769:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218348672:0@lo:41: 00000100:00100000:3.0:1788832079.064837:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832079.066538:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218348672 00000100:00100000:0.0:1788832079.066551:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218348672 00000100:00100000:0.0:1788832079.066645:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788832079.066657:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218348672:12345-0@lo:41: 00000004:00000024:0.0:1788832079.066695:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788832079.066773:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218348672:12345-0@lo:41: Request processed in 118us (1936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832079.066780:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788832079.066834:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218348672:0@lo:41: 00010000:00010000:1.0:1788832079.318920:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832079.574943:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218348800:0@lo:13: 00000100:00100000:0.0:1788832079.575052:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832079.575358:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218348800 00000100:00100000:1.0:1788832079.575369:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218348800 00000100:00100000:1.0:1788832079.575457:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788832079.575474:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218348800:12345-0@lo:13: 00000100:00080000:0.0:1788832079.575485:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1788832079.575514:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832079.576024:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218348800:12345-0@lo:13: Request processed in 553us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832079.576034:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788832079.576103:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36d0c700 x1875726218348800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832079.576117:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788832079.576156:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218348800:0@lo:13: 00000100:00100000:1.0:1788832079.576185:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218349312:0@lo:400: 00000100:00100000:0.0:1788832079.576211:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218348928:0@lo:400: 00000100:00100000:1.0:1788832079.576227:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832079.576264:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218349824:0@lo:400: 00000100:00100000:0.0:1788832079.576295:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832079.576332:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218349440:0@lo:400: 00000100:00100000:0.0:1788832079.576415:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832079.576441:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1875726218349952:0@lo:400: 00000100:00100000:0.0:1788832079.576471:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832079.576496:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788832079.576504:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218349056:0@lo:400: 00000100:00100000:0.0:1788832079.576539:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832079.576558:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218349568:0@lo:400: 00000100:00100000:0.0:1788832079.576589:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832079.576657:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218350080:0@lo:400: 00000100:00100000:3.0:1788832079.576933:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218349184:0@lo:400: 00000100:00100000:1.0:1788832079.583001:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832079.583123:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218349312 00000100:00100000:1.0:1788832079.583136:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218349312 00000100:00100000:1.0:1788832079.583208:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788832079.583222:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218349312:12345-0@lo:400: 00000100:00100000:3.0:1788832079.584977:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218349824 00000100:00100000:3.0:1788832079.584993:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218349824 00000100:00100000:3.0:1788832079.585089:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788832079.585106:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218349824:12345-0@lo:400: 00000100:00100000:3.0:1788832079.585210:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218349824:12345-0@lo:400: Request processed in 108us (2222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832079.585218:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788832079.585245:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788832079.585289:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07656a00 x1875726218349824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832079.585307:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218349824:0@lo:400: 00000100:00100000:3.0:1788832079.585419:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218349312:0@lo:400: 00000100:00100000:3.0:1788832079.585476:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832079.585504:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218349696:0@lo:400: 00000100:00100000:3.0:1788832079.585537:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832079.585567:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218349696 00000100:00100000:3.0:1788832079.585583:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218349696 00000100:00100000:3.0:1788832079.585667:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788832079.585676:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218349696:12345-0@lo:400: 00000100:00100000:3.0:1788832079.586014:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218349696:12345-0@lo:400: Request processed in 339us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832079.586023:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788832079.586052:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788832079.586077:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07655c00 x1875726218349696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832079.586089:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218349696:0@lo:400: 00000100:00100000:3.0:1788832079.586100:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218350208:0@lo:400: 00000100:00100000:3.0:1788832079.586149:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832079.586177:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218350208 00000100:00100000:3.0:1788832079.586182:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218350208 00000100:00100000:3.0:1788832079.586219:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788832079.586227:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218350208:12345-0@lo:400: 00000100:00100000:3.0:1788832079.586265:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218350208:12345-0@lo:400: Request processed in 38us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832079.586271:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788832079.586289:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788832079.586304:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07654a80 x1875726218350208/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832079.586313:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788832079.586327:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218350208:0@lo:400: 00000100:00100000:3.0:1788832079.587064:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218349440 00000100:00100000:3.0:1788832079.587071:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218349440 00000100:00100000:3.0:1788832079.587111:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218349952 00000100:00100000:3.0:1788832079.587115:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218349952 00000100:00100000:3.0:1788832079.587128:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218349056 00000100:00100000:3.0:1788832079.587132:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218349056 00000100:00100000:3.0:1788832079.587142:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218349568 00000100:00100000:3.0:1788832079.587144:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218349568 00000100:00100000:3.0:1788832079.587157:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218349184 00000100:00100000:3.0:1788832079.587160:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218349184 00000100:00100000:3.0:1788832079.587175:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788832079.587183:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218349440:12345-0@lo:400: 00000100:00100000:3.0:1788832079.587240:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218349440:12345-0@lo:400: Request processed in 58us (10825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832079.587247:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788832079.587273:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788832079.587279:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875726218349952:12345-0@lo:400: 00000100:00100000:3.0:1788832079.587309:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875726218349952:12345-0@lo:400: Request processed in 31us (10838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832079.587315:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788832079.587478:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832079.587515:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218349440:0@lo:400: 00000100:00100000:0.0:1788832079.587540:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1875726218349952:0@lo:400: 00000100:00100000:3.0:1788832079.587541:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788832079.587558:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218349056:12345-0@lo:400: 00000100:00100000:0.0:1788832079.587586:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218348928 00000100:00100000:0.0:1788832079.587591:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218348928 00000100:00100000:3.0:1788832079.587617:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218349056:12345-0@lo:400: Request processed in 63us (11077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832079.587647:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788832079.587651:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788832079.587661:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218348928:12345-0@lo:400: 00000100:00100000:3.0:1788832079.587665:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218350080 00000100:00100000:3.0:1788832079.587670:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218350080 00000100:00100000:3.0:1788832079.587690:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788832079.587697:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218349568:12345-0@lo:400: 00000100:00100000:3.0:1788832079.587740:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218349568:12345-0@lo:400: Request processed in 43us (11150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832079.587748:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788832079.587766:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788832079.587774:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218349184:12345-0@lo:400: 00000100:00100000:0.0:1788832079.587783:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218348928:12345-0@lo:400: Request processed in 122us (11489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832079.587791:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788832079.587826:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788832079.587835:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875726218350080:12345-0@lo:400: 00000100:00100000:0.0:1788832079.587866:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875726218350080:12345-0@lo:400: Request processed in 32us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832079.587872:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788832079.587899:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218349184:12345-0@lo:400: Request processed in 125us (2422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832079.587907:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1788832079.587930:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788832079.587934:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832079.587955:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218349056:0@lo:400: 00010000:00080000:3.0:1788832079.587968:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07657100 x1875726218349568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832079.587988:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218349568:0@lo:400: 00010000:00080000:3.0:1788832079.588002:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07654e00 x1875726218350080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832079.588010:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218350080:0@lo:400: 00000100:00100000:3.0:1788832079.588021:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218348928:0@lo:400: 00000100:00100000:3.0:1788832079.588079:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218349184:0@lo:400: 00000100:00100000:1.0:1788832079.590103:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218349312:12345-0@lo:400: Request processed in 6870us (13863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832079.590121:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788832080.088580:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218350336:0@lo:13: 00000100:00100000:0.0:1788832080.088673:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832080.088843:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218350336 00000100:00100000:3.0:1788832080.088851:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218350336 00000100:00100000:3.0:1788832080.088904:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788832080.088914:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218350336:12345-0@lo:13: 00002000:00000024:3.0:1788832080.088935:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832080.090336:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218350336:12345-0@lo:13: Request processed in 1416us (1655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832080.090346:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788832080.090741:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f3100 x1875726218350336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832080.090777:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218350336:0@lo:13: 00010000:00010000:3.0:1788832080.342828:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832080.599406:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788832080.599444:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218350464:0@lo:13: 00000100:00100000:1.0:1788832080.599531:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832080.599662:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218350464 00000100:00100000:2.0:1788832080.599672:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218350464 00000100:00100000:2.0:1788832080.599733:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788832080.599744:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218350464:12345-0@lo:13: 00002000:00000024:2.0:1788832080.599780:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788832080.599824:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218350464:12345-0@lo:13: Request processed in 82us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832080.599832:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788832080.601975:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc07b80 x1875726218350464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832080.602001:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218350464:0@lo:13: 00000020:00000080:1.0:1788832081.108512:0:10337:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1361c090 20000000:00000080:1.0:1788832081.108530:0:10337:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d2c36ece400 uarg=0000000000000000 20000000:01000000:1.0:1788832081.108935:0:10337:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788832081.108938:0:10337:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788832081.108940:0:10337:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788832081.108945:0:10337:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788832081.108950:0:10337:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788832081.109004:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788832081.109007:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788832081.109695:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000100:00100000:3.0:1788832081.110868:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218350592:0@lo:13: 00000100:00100000:3.0:1788832081.110938:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832081.111071:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218350592 00000100:00100000:2.0:1788832081.111079:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218350592 00000100:00100000:2.0:1788832081.111141:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788832081.111153:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218350592:12345-0@lo:13: 00002000:00000024:2.0:1788832081.111188:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788832081.111237:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218350592:12345-0@lo:13: Request processed in 87us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832081.111245:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788832081.111362:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788832081.111392:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc07100 x1875726218350592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832097 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832081.111414:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218350592:0@lo:13: 00000040:00080000:1.0:1788832081.112475:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1788832081.112510:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1788832081.112525:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1788832081.112535:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788832081.112537:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788832081.114293:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1788832081.114791:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1788832081.114826:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1788832081.114843:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1788832081.114857:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788832081.114860:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788832081.115546:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1788832081.115920:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1788832081.115948:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1788832081.115964:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1788832081.115976:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788832081.115979:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788832081.116326:0:10341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1788832081.116675:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1788832081.116716:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1788832081.116731:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1788832081.116740:0:10337:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788832081.116742:0:10337:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788832081.117264:0:10342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1788832081.117511:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1788832081.117534:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1788832081.117550:0:10337:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:1.0:1788832081.117577:0:10337:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788832081.117604:0:10337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d2c390f3400/0x998c12b283536fbd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.117670:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c390f2a00/0x998c12b283536e58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536e51 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.117679:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c092dda00/0x998c12b283536e82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536e7b expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.117695:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c092dd000/0x998c12b283536ec1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536eba expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.117701:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c421d2c00/0x998c12b283536ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536ec8 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.117709:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536ed6 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.117716:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c092ddc00/0x998c12b283536ef9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536ef2 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.117722:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c36db8400/0x998c12b283536f23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536f1c expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.117729:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c390f3c00/0x998c12b283536f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536f38 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.117735:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c092dc400/0x998c12b283536f69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536f62 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.117744:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c421d3000/0x998c12b283536f77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc044e3 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.117761:0:10337:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c421d2a00/0x998c12b283536f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc044ea expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.117769:0:10337:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d2c390f3400/0x998c12b283536fbd lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.117896:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c421d2a00/0x998c12b283536f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc044ea expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.117915:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2c421d2a00/0x998c12b283536f7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc044ea expref: 9 pid: 6518 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832081.117931:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07657b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218350720:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788832081.118048:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c421d3000/0x998c12b283536f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc044e3 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.118065:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2c421d3000/0x998c12b283536f77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc044e3 expref: 9 pid: 6518 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832081.118075:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218350848:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788832081.118113:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c092dc400/0x998c12b283536f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536f62 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.118121:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c092dc400/0x998c12b283536f69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536f62 expref: 23 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832081.118131:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07656d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218350976:0@lo:104: 00000100:00100000:0.0:1788832081.118185:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832081.118221:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c390f3c00/0x998c12b283536f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536f38 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.118229:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c390f3c00/0x998c12b283536f3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536f38 expref: 23 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832081.118237:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07654380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218351104:0@lo:104: 00000100:00100000:0.0:1788832081.118257:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832081.118290:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c36db8400/0x998c12b283536f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536f1c expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.118298:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c36db8400/0x998c12b283536f23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536f1c expref: 23 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832081.118306:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218351232:0@lo:104: 00000100:00100000:0.0:1788832081.118326:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832081.118352:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c092ddc00/0x998c12b283536ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536ef2 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.118360:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c092ddc00/0x998c12b283536ef9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536ef2 expref: 23 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832081.118368:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07657100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218351360:0@lo:104: 00000100:00100000:0.0:1788832081.118391:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832081.118407:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536ed6 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.118415:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536edd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536ed6 expref: 23 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832081.118422:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07654a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218351488:0@lo:104: 00010000:00010000:0.0:1788832081.118442:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c421d2c00/0x998c12b283536ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536ec8 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.118448:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c421d2c00/0x998c12b283536ecf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536ec8 expref: 23 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832081.118455:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218351616:0@lo:104: 00010000:00010000:0.0:1788832081.118469:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c092dd000/0x998c12b283536ec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536eba expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.118475:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c092dd000/0x998c12b283536ec1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536eba expref: 23 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832081.118481:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07656a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218351744:0@lo:104: 00010000:00010000:0.0:1788832081.118511:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c092dda00/0x998c12b283536e82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536e7b expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.118521:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c092dda00/0x998c12b283536e82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536e7b expref: 23 pid: 6518 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832081.118528:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218351872:0@lo:104: 00010000:00010000:0.0:1788832081.118552:0:10337:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c390f2a00/0x998c12b283536e58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536e51 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.118571:0:10337:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c390f2a00/0x998c12b283536e58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536e51 expref: 23 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832081.118580:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218352000:0@lo:104: 00000100:00100000:0.0:1788832081.118599:0:10337:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c39116480 going to sleep for 11 seconds 00000100:00100000:2.0:1788832081.118707:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788832081.118728:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832081.118743:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832081.118751:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832081.118768:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832081.118777:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832081.118786:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218350976 00000100:00100000:2.0:1788832081.118792:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218350976 00000100:00100000:2.0:1788832081.118833:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218351104 00000100:00100000:2.0:1788832081.118836:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218351104 00000100:00100000:2.0:1788832081.118845:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218351232 00000100:00100000:2.0:1788832081.118848:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218351232 00000100:00100000:2.0:1788832081.118856:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218351360 00000100:00100000:2.0:1788832081.118858:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218351360 00000100:00100000:2.0:1788832081.118866:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218351488 00000100:00100000:2.0:1788832081.118867:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218351488 00000100:00100000:2.0:1788832081.118875:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218351616 00000100:00100000:2.0:1788832081.118877:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218351616 00000100:00100000:2.0:1788832081.118884:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218351744 00000100:00100000:2.0:1788832081.118886:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218351744 00000100:00100000:2.0:1788832081.118893:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218351872 00000100:00100000:2.0:1788832081.118895:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218351872 00000100:00100000:2.0:1788832081.118903:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218352000 00000100:00100000:2.0:1788832081.118906:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218352000 00000100:00100000:2.0:1788832081.118917:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788832081.118925:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07656680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+11:10337:x1875726218350976:12345-0@lo:104: 00010000:00010000:2.0:1788832081.118938:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8e00/0x998c12b283536f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536f69 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832081.118995:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788832081.119001:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07656680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+11:10337:x1875726218350976:12345-0@lo:104: Request processed in 77us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832081.119009:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788832081.119027:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788832081.119032:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07654000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+10:10337:x1875726218351104:12345-0@lo:104: 00010000:00010000:2.0:1788832081.119041:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283536f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536f3f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832081.119077:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788832081.119083:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07654000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+10:10337:x1875726218351104:12345-0@lo:104: Request processed in 51us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832081.119089:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788832081.119106:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788832081.119113:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07654e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+9:10337:x1875726218351232:12345-0@lo:104: 00010000:00010000:2.0:1788832081.119122:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9c00/0x998c12b283536f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536f23 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832081.119136:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07656d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218350976:0@lo:104: 00000100:00100000:0.0:1788832081.119152:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07654380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218351104:0@lo:104: 00010000:00010000:2.0:1788832081.119155:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788832081.119162:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218351232:0@lo:104: 00000100:00100000:2.0:1788832081.119411:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07654e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+9:10337:x1875726218351232:12345-0@lo:104: Request processed in 298us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832081.119418:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788832081.119432:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788832081.119440:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06555050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+8:10337:x1875726218351360:12345-0@lo:104: 00010000:00010000:2.0:1788832081.119447:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b283536ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536ef9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832081.119489:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788832081.119494:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06555050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+8:10337:x1875726218351360:12345-0@lo:104: Request processed in 57us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832081.119499:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788832081.119526:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788832081.119532:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+7:10337:x1875726218351488:12345-0@lo:104: 00010000:00010000:2.0:1788832081.119539:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc200/0x998c12b283536ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536edd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832081.119583:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788832081.119588:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+7:10337:x1875726218351488:12345-0@lo:104: Request processed in 57us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832081.119595:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788832081.119609:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788832081.119616:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+6:10337:x1875726218351616:12345-0@lo:104: 00000100:00100000:0.0:1788832081.119641:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07657100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218351360:0@lo:104: 00010000:00010000:2.0:1788832081.119646:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c092dca00/0x998c12b283536ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536ecf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832081.119653:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07654a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218351488:0@lo:104: 00010000:00010000:2.0:1788832081.119909:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788832081.119915:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+6:10337:x1875726218351616:12345-0@lo:104: Request processed in 300us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832081.119921:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788832081.119936:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788832081.119945:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+5:10337:x1875726218351744:12345-0@lo:104: 00010000:00010000:2.0:1788832081.119953:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9800/0x998c12b283536eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536ec1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832081.119958:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218351616:0@lo:104: 00010000:00010000:2.0:1788832081.119988:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788832081.119995:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+5:10337:x1875726218351744:12345-0@lo:104: Request processed in 52us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832081.120001:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788832081.120003:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07656a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218351744:0@lo:104: 00010000:00010000:3.0:1788832081.120236:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788832081.120244:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8e00/0x998c12b283536f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536f69 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120252:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c36db8e00 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832081.120257:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8e00/0x998c12b283536f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536f69 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120265:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8e00/0x998c12b283536f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536f69 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832081.120273:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8e00/0x998c12b283536f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536f69 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832081.120279:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788832081.120325:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8e00/0x998c12b283536f62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536f69 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120452:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832081.120482:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8e00/0x998c12b283536f62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536f69 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120490:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8e00/0x998c12b283536f62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536f69 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120504:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788832081.120508:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283536f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536f3f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120523:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c390f3800 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832081.120526:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283536f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536f3f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120533:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283536f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536f3f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832081.120539:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283536f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536f3f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832081.120544:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788832081.120570:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283536f38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536f3f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120576:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832081.120582:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283536f38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536f3f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120588:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283536f38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536f3f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120598:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788832081.120601:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9c00/0x998c12b283536f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536f23 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120607:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c36db9c00 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832081.120610:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9c00/0x998c12b283536f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536f23 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120656:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9c00/0x998c12b283536f1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536f23 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832081.120674:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9c00/0x998c12b283536f1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536f23 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832081.120679:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788832081.120777:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9c00/0x998c12b283536f1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536f23 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120783:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832081.120798:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9c00/0x998c12b283536f1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536f23 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120805:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9c00/0x998c12b283536f1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536f23 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120814:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788832081.120817:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b283536ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536ef9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120822:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c36db9200 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832081.120824:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b283536ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536ef9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120830:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b283536ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536ef9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832081.120836:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b283536ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536ef9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832081.120846:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788832081.120863:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b283536ef2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536ef9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120869:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832081.120874:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b283536ef2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536ef9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120880:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b283536ef2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536ef9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120887:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788832081.120891:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc200/0x998c12b283536ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536edd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120896:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc200 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832081.120899:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc200/0x998c12b283536ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536edd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120905:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc200/0x998c12b283536ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536edd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832081.120911:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc200/0x998c12b283536ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536edd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832081.120916:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788832081.120926:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc200/0x998c12b283536ed6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536edd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120931:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832081.120942:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc200/0x998c12b283536ed6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536edd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120948:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc200/0x998c12b283536ed6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536edd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120956:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788832081.120959:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c092dca00/0x998c12b283536ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536ecf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120965:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dca00 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832081.120968:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dca00/0x998c12b283536ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536ecf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.120974:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c092dca00/0x998c12b283536ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536ecf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832081.120980:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dca00/0x998c12b283536ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536ecf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832081.120984:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788832081.120996:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c092dca00/0x998c12b283536ec8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536ecf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.121001:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832081.121006:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dca00/0x998c12b283536ec8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536ecf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.121011:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c092dca00/0x998c12b283536ec8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536ecf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.121019:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832081.121027:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9800/0x998c12b283536eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536ec1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.121033:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c36db9800 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832081.121036:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9800/0x998c12b283536eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536ec1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.121043:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9800/0x998c12b283536eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536ec1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832081.121049:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9800/0x998c12b283536eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536ec1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832081.121055:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788832081.121067:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9800/0x998c12b283536eba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536ec1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.121071:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832081.121075:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9800/0x998c12b283536eba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536ec1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.121080:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9800/0x998c12b283536eba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536ec1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.121089:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832081.121091:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832081.121093:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832081.121115:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218352256:0@lo:103: 00000100:00100000:2.0:1788832081.121281:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788832081.121292:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218352128:0@lo:103: 00000100:00100000:2.0:1788832081.121294:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+4:10337:x1875726218351872:12345-0@lo:104: 00010000:00010000:2.0:1788832081.121308:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8200/0x998c12b283536e7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536e82 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.121555:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832081.126693:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832081.126757:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218352640:0@lo:103: 00000100:00100000:0.0:1788832081.126800:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788832081.126876:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788832081.126887:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+4:10337:x1875726218351872:12345-0@lo:104: Request processed in 5595us (8114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832081.126897:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788832081.126902:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218351872:0@lo:104: 00000100:00100000:2.0:1788832081.126931:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788832081.126943:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+3:10337:x1875726218352000:12345-0@lo:104: 00010000:00010000:2.0:1788832081.126959:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd600/0x998c12b283536e51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536e58 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832081.127013:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788832081.127017:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+3:10337:x1875726218352000:12345-0@lo:104: Request processed in 80us (8240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832081.127023:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788832081.127060:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218352512:0@lo:103: 00000100:00100000:2.0:1788832081.127083:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788832081.127172:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788832081.127179:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8200/0x998c12b283536e7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536e82 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.127198:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c36db8200 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832081.127202:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8200/0x998c12b283536e7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536e82 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.127210:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8200/0x998c12b283536e7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536e82 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832081.127217:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8200/0x998c12b283536e7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536e82 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832081.127221:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788832081.127253:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8200/0x998c12b283536e7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536e82 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.127260:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832081.127270:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8200/0x998c12b283536e7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536e82 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.127276:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8200/0x998c12b283536e7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536e82 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.127289:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832081.127292:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd600/0x998c12b283536e51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536e58 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.127298:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dd600 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832081.127301:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd600/0x998c12b283536e51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536e58 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.127318:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd600/0x998c12b283536e51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536e58 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832081.127324:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd600/0x998c12b283536e51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536e58 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832081.127341:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788832081.127356:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd600/0x998c12b283536e51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536e58 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.127362:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832081.127375:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd600/0x998c12b283536e51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536e58 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.127381:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd600/0x998c12b283536e51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536e58 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.127394:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832081.127396:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832081.127397:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832081.127411:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218353152:0@lo:103: 00000100:00100000:2.0:1788832081.127581:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218353024:0@lo:103: 00000100:00100000:2.0:1788832081.127605:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832081.127715:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218352128 00000100:00100000:1.0:1788832081.127723:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218352128 00010000:00010000:1.0:1788832081.127753:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c092dc400/0x998c12b283536f69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536f62 expref: 24 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832081.127776:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218352640 00000100:00100000:1.0:1788832081.127779:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218352640 00010000:00010000:1.0:1788832081.127790:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536edd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536ed6 expref: 25 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832081.127799:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218352512 00000100:00100000:1.0:1788832081.127801:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218352512 00010000:00010000:1.0:1788832081.127810:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c092ddc00/0x998c12b283536ef9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536ef2 expref: 26 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832081.127821:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788832081.127827:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18e24450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+26:3653:x1875726218352128:12345-0@lo:103: 00010000:00010000:1.0:1788832081.127838:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832081.127843:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c092dc400/0x998c12b283536f69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536f62 expref: 26 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.127852:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c092dc400/0x998c12b283536f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536f62 expref: 26 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.127875:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c092dc400/0x998c12b283536f69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536f62 expref: 26 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.127889:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832081.127920:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18e24450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+25:3653:x1875726218352128:12345-0@lo:103: Request processed in 94us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832081.127927:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788832081.127948:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07657b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218350720:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788832081.127962:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218350848:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788832081.127972:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788832081.127976:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10337:1875726218352000:0@lo:104: 00000100:00100000:1.0:1788832081.127982:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+24:3653:x1875726218352640:12345-0@lo:103: 00010000:00010000:1.0:1788832081.127990:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832081.127996:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536edd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536ed6 expref: 24 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.128004:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536ed6 expref: 24 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.128017:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c421d2e00/0x998c12b283536edd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536ed6 expref: 24 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.128026:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788832081.128028:0:10337:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d2c390f3400/0x998c12b283536fbd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832081.128049:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+23:3653:x1875726218352640:12345-0@lo:103: Request processed in 69us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832081.128056:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788832081.128066:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788832081.128072:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+22:3652:x1875726218352512:12345-0@lo:103: 00010000:00010000:1.0:1788832081.128079:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832081.128083:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c092ddc00/0x998c12b283536ef9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536ef2 expref: 22 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.128097:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c092ddc00/0x998c12b283536ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536ef2 expref: 22 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.128107:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c092ddc00/0x998c12b283536ef9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536ef2 expref: 22 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.128115:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832081.128135:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+21:3652:x1875726218352512:12345-0@lo:103: Request processed in 64us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832081.128140:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1788832081.128179:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832081.128587:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218352512:0@lo:103: 00000100:00100000:2.0:1788832081.128602:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788832081.128608:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218352384:0@lo:103: 00000100:00100000:2.0:1788832081.128653:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832081.128695:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218352896:0@lo:103: 00000100:00100000:2.0:1788832081.128715:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832081.128773:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832081.128801:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218352768:0@lo:103: 00000100:00100000:2.0:1788832081.128821:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832081.128842:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832081.128859:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218352128:0@lo:103: 00000100:00100000:2.0:1788832081.128868:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218352640:0@lo:103: 00000100:00100000:2.0:1788832081.128899:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832081.128987:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832081.129204:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218353024 00000100:00100000:1.0:1788832081.129210:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218353024 00010000:00010000:1.0:1788832081.129233:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c092dda00/0x998c12b283536e82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536e7b expref: 21 pid: 6518 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832081.129251:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218352384 00000100:00100000:1.0:1788832081.129254:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218352384 00010000:00010000:1.0:1788832081.129266:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c36db8400/0x998c12b283536f23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536f1c expref: 22 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832081.129276:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218352896 00000100:00100000:1.0:1788832081.129278:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218352896 00010000:00010000:1.0:1788832081.129288:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c092dd000/0x998c12b283536ec1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536eba expref: 23 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832081.129297:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218352256 00000100:00100000:1.0:1788832081.129299:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218352256 00010000:00010000:1.0:1788832081.129307:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c390f3c00/0x998c12b283536f3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536f38 expref: 24 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832081.129341:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218352768 00000100:00100000:1.0:1788832081.129343:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218352768 00010000:00010000:1.0:1788832081.129355:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c421d2c00/0x998c12b283536ecf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536ec8 expref: 25 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832081.129365:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218353152 00000100:00100000:1.0:1788832081.129367:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218353152 00010000:00010000:1.0:1788832081.129377:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c390f2a00/0x998c12b283536e58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536e51 expref: 26 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832081.129386:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202573568 00000100:00100000:1.0:1788832081.129389:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202573568 00010000:00010000:1.0:1788832081.129399:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c421d2a00/0x998c12b283536f7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc044ea expref: 10 pid: 6518 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832081.129409:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202573696 00000100:00100000:1.0:1788832081.129411:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202573696 00010000:00010000:1.0:1788832081.129420:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c421d3000/0x998c12b283536f77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc044e3 expref: 11 pid: 6518 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832081.129433:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788832081.129440:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+26:3652:x1875726218353024:12345-0@lo:103: 00010000:00010000:1.0:1788832081.129449:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832081.129453:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c092dda00/0x998c12b283536e82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536e7b expref: 26 pid: 6518 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.129462:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c092dda00/0x998c12b283536e82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536e7b expref: 26 pid: 6518 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.129475:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c092dda00/0x998c12b283536e82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536e7b expref: 26 pid: 6518 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.129492:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832081.129536:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+25:3652:x1875726218353024:12345-0@lo:103: Request processed in 96us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832081.129542:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788832081.129556:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788832081.129574:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+24:3652:x1875726218352384:12345-0@lo:103: 00010000:00010000:1.0:1788832081.129581:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832081.129585:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c36db8400/0x998c12b283536f23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536f1c expref: 24 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.129594:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c36db8400/0x998c12b283536f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536f1c expref: 24 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.129603:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c36db8400/0x998c12b283536f23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536f1c expref: 24 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.129613:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832081.129643:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788832081.129654:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e55f0905-9d39-4464-9830-326b420fb582+23:3652:x1875726218352896:12345-0@lo:103: 00010000:00010000:0.0:1788832081.129664:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832081.129670:0:7466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c092dd000/0x998c12b283536ec1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536eba expref: 23 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.129691:0:7466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c092dd000/0x998c12b283536ec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536eba expref: 23 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.129702:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c092dd000/0x998c12b283536ec1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536eba expref: 23 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.129711:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832081.129792:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+22:3652:x1875726218352384:12345-0@lo:103: Request processed in 218us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832081.129798:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788832081.129812:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788832081.129818:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+21:3654:x1875726218352256:12345-0@lo:103: 00010000:00010000:1.0:1788832081.129825:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832081.129831:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c390f3c00/0x998c12b283536f3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536f38 expref: 21 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.129839:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c390f3c00/0x998c12b283536f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536f38 expref: 21 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.129855:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c390f3c00/0x998c12b283536f3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536f38 expref: 21 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832081.129865:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832081.129935:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218352384:0@lo:103: 00000100:00100000:2.0:1788832081.129946:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218353024:0@lo:103: 00000100:00100000:3.0:1788832081.130198:0:6510:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788832081.130207:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:2.0:1788832081.133833:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788832081.133857:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e55f0905-9d39-4464-9830-326b420fb582+20:3654:x1875726218352768:12345-0@lo:103: 00010000:00010000:2.0:1788832081.133876:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832081.133886:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c421d2c00/0x998c12b283536ecf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536ec8 expref: 20 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832081.133899:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c421d2c00/0x998c12b283536ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536ec8 expref: 20 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832081.133919:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c421d2c00/0x998c12b283536ecf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536ec8 expref: 20 pid: 6519 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832081.133935:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832081.134068:0:10343:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:3.0:1788832081.134076:0:10343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_005' 00000100:00100000:3.0:1788832081.134137:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788832081.134145:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e55f0905-9d39-4464-9830-326b420fb582+19:3653:x1875726218353152:12345-0@lo:103: 00010000:00010000:3.0:1788832081.134153:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832081.134170:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c390f2a00/0x998c12b283536e58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536e51 expref: 19 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.134179:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c390f2a00/0x998c12b283536e58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536e51 expref: 19 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.134189:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c390f2a00/0x998c12b283536e58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536e51 expref: 19 pid: 6517 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832081.134197:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832081.135806:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e55f0905-9d39-4464-9830-326b420fb582+18:3652:x1875726218352896:12345-0@lo:103: Request processed in 6147us (7081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832081.135819:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788832081.135857:0:7466:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:0.0:1788832081.135871:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:0.0:1788832081.135884:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18e26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:229a6744-cc0e-4765-812a-1d39bc7df2da+11:2394:x1875726202573568:12345-192.168.203.26@tcp:103: 00010000:00010000:0.0:1788832081.135901:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832081.135911:0:7466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c421d2a00/0x998c12b283536f7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc044ea expref: 11 pid: 6518 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.135941:0:7466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c421d2a00/0x998c12b283536f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc044ea expref: 11 pid: 6518 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.135960:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c421d2a00/0x998c12b283536f7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc044ea expref: 11 pid: 6518 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.135977:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832081.136026:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18e26850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:229a6744-cc0e-4765-812a-1d39bc7df2da+10:2394:x1875726202573568:12345-192.168.203.26@tcp:103: Request processed in 147us (7128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832081.136033:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:0.0:1788832081.138243:0:7466:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:0.0:1788832081.138259:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:0.0:1788832081.138272:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:229a6744-cc0e-4765-812a-1d39bc7df2da+9:2393:x1875726202573696:12345-192.168.203.26@tcp:103: 00010000:00010000:0.0:1788832081.138288:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832081.138297:0:7466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c421d3000/0x998c12b283536f77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc044e3 expref: 9 pid: 6518 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.138312:0:7466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c421d3000/0x998c12b283536f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc044e3 expref: 9 pid: 6518 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832081.138316:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+17:3654:x1875726218352256:12345-0@lo:103: Request processed in 8495us (9539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832081.138328:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1788832081.138336:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c421d3000/0x998c12b283536f77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc044e3 expref: 9 pid: 6518 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.138354:0:7466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d2c390f3400/0x998c12b283536fbd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.138363:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c390f3400/0x998c12b283536fbd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.138396:0:7466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c390f3400/0x998c12b283536fbd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.138404:0:7466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c390f3400/0x998c12b283536fbd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.138411:0:7466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d2c390f3400/0x998c12b283536fbd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.138419:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d2c390f3400/0x998c12b283536fbd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.138425:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c390f3400 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:0.0:1788832081.138430:0:7466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d2c390f3400/0x998c12b283536fbd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.138438:0:7466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d2c390f3400/0x998c12b283536fbd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.138454:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d2c390f3400/0x998c12b283536fbd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.138464:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832081.138503:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:229a6744-cc0e-4765-812a-1d39bc7df2da+8:2393:x1875726202573696:12345-192.168.203.26@tcp:103: Request processed in 235us (9515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832081.138510:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:1.0:1788832081.138874:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218352256:0@lo:103: 00000100:00100000:0.0:1788832081.139252:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218352896:0@lo:103: 00010000:00010000:0.0:1788832081.139283:0:10337:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d2c390f3400/0x998c12b283536fbd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.139305:0:10337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d2c390f3400/0x998c12b283536fbd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832081.139312:0:10337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c390f3400/0x998c12b283536fbd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832081.140557:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e55f0905-9d39-4464-9830-326b420fb582+16:3654:x1875726218352768:12345-0@lo:103: Request processed in 6704us (11728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832081.140577:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788832081.140664:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e55f0905-9d39-4464-9830-326b420fb582+15:3653:x1875726218353152:12345-0@lo:103: Request processed in 6519us (11820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832081.140694:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218353152:0@lo:103: 00000100:00100000:3.0:1788832081.140759:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788832081.141202:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218352768:0@lo:103: 00010000:00010000:3.0:1788832081.366991:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832082.390864:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832082.644699:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832082.644743:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832082.644776:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832082.644805:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832082.644833:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832082.644843:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202573952 00000100:00100000:2.0:1788832082.644854:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202573824 00000100:00100000:0.0:1788832082.644854:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202573952 00000100:00100000:2.0:1788832082.644858:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202573824 00000100:00100000:1.0:1788832082.644873:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202574080 00000100:00100000:1.0:1788832082.644878:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202574080 00000100:00100000:2.0:1788832082.644906:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 198 00000100:00100000:0.0:1788832082.644906:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:1.0:1788832082.644915:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:2.0:1788832082.644921:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+8:2393:x1875726202573824:12345-192.168.203.26@tcp:400: 00000100:00100000:0.0:1788832082.644922:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202573952:12345-192.168.203.26@tcp:400: 00000100:00100000:1.0:1788832082.644931:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202574080:12345-192.168.203.26@tcp:400: 00000100:00100000:2.0:1788832082.644988:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+8:2393:x1875726202573824:12345-192.168.203.26@tcp:400: Request processed in 72us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832082.644996:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 198 00000100:00100000:3.0:1788832082.645014:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202574208 00000100:00100000:3.0:1788832082.645020:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202574208 00000100:00100000:3.0:1788832082.645054:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202574336 00000100:00100000:3.0:1788832082.645058:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202574336 00000100:00100000:3.0:1788832082.645081:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:3.0:1788832082.645090:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202574208:12345-192.168.203.26@tcp:400: 00000100:00100000:1.0:1788832082.645152:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202574080:12345-192.168.203.26@tcp:400: Request processed in 226us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832082.645160:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00080000:1.0:1788832082.645201:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788832082.645205:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788832082.645208:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788832082.645210:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832082.645237:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:1.0:1788832082.645245:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202574336:12345-192.168.203.26@tcp:400: 00000100:00100000:1.0:1788832082.645273:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202574336:12345-192.168.203.26@tcp:400: Request processed in 29us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832082.645279:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:0.0:1788832082.645434:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202573952:12345-192.168.203.26@tcp:400: Request processed in 518us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832082.645443:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 57 10000000:01000000:1.0:1788832082.646822:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788832082.646828:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d2c3fcaa000 from 48 10000000:01000000:1.0:1788832082.646834:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788832082.646884:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.646896:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.646908:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832082.646931:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218353280:0@lo:101: 00000100:00100000:1.0:1788832082.646988:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832082.647047:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b065899c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832082.647131:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218353280 00000100:00100000:0.0:1788832082.647139:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218353280 00000100:00100000:0.0:1788832082.647193:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788832082.647202:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+15:6522:x1875726218353280:12345-0@lo:101: 00010000:00010000:0.0:1788832082.647214:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832082.647229:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c36db9e00/0x998c12b283536fcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536fc4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832082.647251:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c36db9e00/0x998c12b283536fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536fc4 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832082.647261:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c36db9e00/0x998c12b283536fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536fc4 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832082.647270:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c36db9e00, rc 0) 00000100:00100000:0.0:1788832082.647324:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218353280:12345-0@lo:101: Request processed in 123us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832082.647331:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788832082.647379:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218353280:0@lo:101: 00010000:00010000:0.0:1788832082.647393:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536fcb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832082.647401:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536fcb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832082.647455:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218353408:0@lo:501: 00000100:00100000:0.0:1788832082.647479:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832082.647506:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c391163c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832082.647577:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218353408 00000100:00100000:1.0:1788832082.647594:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218353408 00000100:00100000:1.0:1788832082.647642:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788832082.647649:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218353408:12345-0@lo:501: 00000100:00100000:1.0:1788832082.647756:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218353408:12345-0@lo:501: Request processed in 108us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832082.647763:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788832082.648278:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218353408:0@lo:501: 00000100:00100000:0.0:1788832082.648312:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218353536:0@lo:503: 00000100:00100000:0.0:1788832082.648357:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832082.648391:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c391163c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832082.648935:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218353536 00000100:00100000:1.0:1788832082.648949:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218353536 00000100:00100000:1.0:1788832082.648994:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788832082.649002:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218353536:12345-0@lo:503: 00000100:00100000:1.0:1788832082.649112:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218353536:12345-0@lo:503: Request processed in 110us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832082.649119:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788832082.649211:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218353536:0@lo:503: 00000100:00100000:3.0:1788832082.650003:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202574208:12345-192.168.203.26@tcp:400: Request processed in 4910us (5254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832082.650014:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:0.0:1788832082.650326:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10356:1875726218353664:0@lo:502: 00000100:00100000:0.0:1788832082.650380:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832082.650418:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c39116480 going to sleep for 11 seconds 00000100:00100000:1.0:1788832082.650497:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218353664 00000100:00100000:1.0:1788832082.650504:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218353664 00000100:00100000:1.0:1788832082.650543:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788832082.650562:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+16:10356:x1875726218353664:12345-0@lo:502: 00000100:00100000:1.0:1788832082.650983:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+16:10356:x1875726218353664:12345-0@lo:502: Request processed in 431us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832082.650990:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788832082.651080:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10356:1875726218353664:0@lo:502: 00000100:00100000:0.0:1788832082.651126:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10356:1875726218353792:0@lo:502: 00000100:00100000:0.0:1788832082.651158:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832082.651188:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c39116480 going to sleep for 11 seconds 00000100:00100000:1.0:1788832082.651464:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218353792 00000100:00100000:1.0:1788832082.651469:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218353792 00000100:00100000:1.0:1788832082.651504:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788832082.651511:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+16:10356:x1875726218353792:12345-0@lo:502: 00000100:00100000:1.0:1788832082.651799:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+16:10356:x1875726218353792:12345-0@lo:502: Request processed in 287us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832082.651805:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788832082.651895:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10356:1875726218353792:0@lo:502: 00000040:00080000:2.0:1788832082.651922:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788832082.652140:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788832082.652163:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788832082.652172:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536fcb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.652184:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536fcb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832082.652212:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788832082.652214:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788832082.652217:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788832082.652244:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.652251:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.652261:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832082.652277:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218353920:0@lo:101: 00000100:00100000:1.0:1788832082.652315:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832082.652347:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06589600 going to sleep for 11 seconds 00000100:00100000:0.0:1788832082.652401:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218353920 00000100:00100000:0.0:1788832082.652406:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218353920 00000100:00100000:0.0:1788832082.652442:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788832082.652450:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+16:6522:x1875726218353920:12345-0@lo:101: 00010000:00010000:0.0:1788832082.652460:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832082.652472:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c36db9600/0x998c12b283536fd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536fd2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832082.652496:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c36db9600/0x998c12b283536fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536fd2 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832082.652507:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c36db9600/0x998c12b283536fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536fd2 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832082.652515:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c36db9600, rc 0) 00000100:00100000:2.0:1788832082.652842:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218353920:0@lo:101: 00010000:00010000:2.0:1788832082.652856:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536fd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536fd9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832082.652866:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536fd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536fd9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832082.652924:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218354048:0@lo:501: 00000100:00100000:2.0:1788832082.652953:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832082.652982:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c358c2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788832082.653046:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218353920:12345-0@lo:101: Request processed in 130us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832082.653050:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218354048 00000100:00100000:0.0:1788832082.653058:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788832082.653066:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218354048 00000100:00100000:3.0:1788832082.653126:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788832082.653138:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218354048:12345-0@lo:501: 00000100:00100000:3.0:1788832082.653467:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218354048:12345-0@lo:501: Request processed in 331us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832082.653491:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788832082.653696:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218354048:0@lo:501: 00000100:00100000:2.0:1788832082.653749:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218354176:0@lo:503: 00000100:00100000:2.0:1788832082.653803:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832082.653846:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c358c2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788832082.653911:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218354176 00000100:00100000:0.0:1788832082.653917:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218354176 00000100:00100000:0.0:1788832082.654031:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788832082.654040:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218354176:12345-0@lo:503: 00000100:00100000:0.0:1788832082.654334:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218354176:12345-0@lo:503: Request processed in 294us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832082.654341:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788832082.654425:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218354176:0@lo:503: 00000100:00100000:2.0:1788832082.655103:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10357:1875726218354304:0@lo:502: 00000100:00100000:2.0:1788832082.655236:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832082.655346:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c11fcaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832082.655407:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218354304 00000100:00100000:3.0:1788832082.655413:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218354304 00000100:00100000:3.0:1788832082.655457:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788832082.655466:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+17:10357:x1875726218354304:12345-0@lo:502: 00000100:00100000:3.0:1788832082.655790:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+17:10357:x1875726218354304:12345-0@lo:502: Request processed in 324us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832082.655798:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788832082.656018:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10357:1875726218354304:0@lo:502: 00000020:01000000:2.0:1788832082.656051:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832082.656062:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832082.656064:0:10357:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788832082.656069:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788832082.656098:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10357:1875726218354432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832082.656134:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832082.656396:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c11fcaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788832082.660367:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218354432 00000100:00100000:0.0:1788832082.660387:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218354432 00000100:00100000:0.0:1788832082.660470:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788832082.660482:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:10357:x1875726218354432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832082.662664:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+17:10357:x1875726218354432:12345-0@lo:502:llog_process_th.0 Request processed in 2171us (6515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832082.662682:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788832082.662879:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10357:1875726218354432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788832082.662941:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832082.662953:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832082.662955:0:10357:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788832082.662962:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1788832082.663667:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788832082.663696:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788832082.663710:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536fd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536fd9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832082.663725:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536fd9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832082.663738:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788832082.663742:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d2c3e677800 from 48 10000000:01000000:0.0:1788832082.663745:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788832082.663793:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9000/0x998c12b283536fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832082.663802:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9000/0x998c12b283536fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832082.663813:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9000/0x998c12b283536fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832082.663841:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218354560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788832082.663910:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832082.663966:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3483f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788832082.664253:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218354560 00000100:00100000:1.0:1788832082.664261:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218354560 00000100:00100000:1.0:1788832082.664334:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788832082.664345:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+17:6522:x1875726218354560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788832082.664363:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832082.664382:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c390f3e00/0x998c12b283536fe7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536fe0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.664413:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c390f3e00/0x998c12b283536fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536fe0 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.664426:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c390f3e00/0x998c12b283536fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536fe0 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.664459:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c390f3e00, rc 0) 00000100:00100000:1.0:1788832082.664505:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+18:6522:x1875726218354560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832082.664512:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788832082.664854:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218354560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832082.664872:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9000/0x998c12b283536fe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536fe7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832082.664890:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9000/0x998c12b283536fe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536fe7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832082.664983:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218354688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832082.665018:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832082.665050:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3483f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788832082.665347:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218354688 00000100:00100000:1.0:1788832082.665353:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218354688 00000100:00100000:1.0:1788832082.665391:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788832082.665399:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+18:6522:x1875726218354688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832082.666048:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+18:6522:x1875726218354688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 647us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832082.666058:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788832082.666531:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218354688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832082.669685:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218354816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832082.669803:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832082.669855:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3483f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788832082.669993:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218354816 00000100:00100000:1.0:1788832082.670003:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218354816 00000100:00100000:1.0:1788832082.670076:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788832082.670088:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+18:6522:x1875726218354816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788832082.670688:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+18:6522:x1875726218354816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 598us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832082.670698:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788832082.671431:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218354816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832082.673225:0:10358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10358:1875726218354944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832082.673698:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832082.673754:0:10358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832082.673875:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218354944 00000100:00100000:0.0:1788832082.673884:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218354944 00000100:00100000:0.0:1788832082.674315:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788832082.674329:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+18:10358:x1875726218354944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832082.674500:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+18:10358:x1875726218354944:12345-0@lo:502:llog_process_th.0 Request processed in 174us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832082.674508:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788832082.675112:0:10358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10358:1875726218354944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832082.675242:0:10358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10358:1875726218355072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832082.675437:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832082.675473:0:10358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832082.675697:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218355072 00000100:00100000:0.0:1788832082.675705:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218355072 00000100:00100000:0.0:1788832082.675787:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788832082.675795:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+18:10358:x1875726218355072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832082.675904:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+18:10358:x1875726218355072:12345-0@lo:502:llog_process_th.0 Request processed in 109us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832082.675930:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788832082.676007:0:10358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10358:1875726218355072:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788832082.676029:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788832082.678946:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788832082.679001:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788832082.679018:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9000/0x998c12b283536fe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536fe7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832082.679033:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9000/0x998c12b283536fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536fe7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832082.679046:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788832082.679049:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788832082.679052:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788832082.679105:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc800/0x998c12b283536fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832082.679114:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc800/0x998c12b283536fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832082.679128:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc800/0x998c12b283536fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832082.679197:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218355200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788832082.679287:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832082.684798:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c11fcab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788832082.688250:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218355200 00000100:00100000:1.0:1788832082.688275:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218355200 00000100:00100000:1.0:1788832082.688367:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788832082.688379:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+18:6522:x1875726218355200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788832082.688403:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832082.688430:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c390f3200/0x998c12b283536ff5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536fee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.688494:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c390f3200/0x998c12b283536ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536fee expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.688509:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c390f3200/0x998c12b283536ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536fee expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.688522:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c390f3200, rc 0) 00000100:00100000:1.0:1788832082.689669:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+19:6522:x1875726218355200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1283us (10373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832082.689682:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788832082.692330:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218355200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832082.692370:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc800/0x998c12b283536fee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536ff5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832082.692387:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc800/0x998c12b283536fee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536ff5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832082.692502:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218355328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832082.693814:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832082.693878:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c11fcab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788832082.694062:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218355328 00000100:00100000:1.0:1788832082.694073:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218355328 00000100:00100000:1.0:1788832082.694273:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788832082.694287:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+19:6522:x1875726218355328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832082.694479:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+19:6522:x1875726218355328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832082.694488:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788832082.694591:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218355328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832082.694686:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218355456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832082.694750:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832082.698381:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c11fcab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832082.698817:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218355456 00000100:00100000:0.0:1788832082.698829:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218355456 00000100:00100000:0.0:1788832082.698903:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788832082.698915:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+19:6522:x1875726218355456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832082.699151:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+19:6522:x1875726218355456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 238us (4399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832082.699160:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788832082.699258:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218355456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832082.702277:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10359:1875726218355584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832082.702382:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832082.702438:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c11fca240 going to sleep for 11 seconds 00000100:00100000:0.0:1788832082.702570:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218355584 00000100:00100000:0.0:1788832082.702579:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218355584 00000100:00100000:0.0:1788832082.702673:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788832082.702685:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+19:10359:x1875726218355584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832082.702839:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+19:10359:x1875726218355584:12345-0@lo:502:llog_process_th.0 Request processed in 156us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832082.702848:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788832082.703095:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10359:1875726218355584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832082.703131:0:10359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832082.703142:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832082.703154:0:10359:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788832082.703169:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788832082.703194:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10359:1875726218355712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832082.703229:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832082.703262:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c11fca240 going to sleep for 11 seconds 00000100:00100000:0.0:1788832082.703368:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218355712 00000100:00100000:0.0:1788832082.703372:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218355712 00000100:00100000:0.0:1788832082.703406:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788832082.703413:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+19:10359:x1875726218355712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832082.703485:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+19:10359:x1875726218355712:12345-0@lo:502:llog_process_th.0 Request processed in 71us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832082.703492:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788832082.704041:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10359:1875726218355712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832082.704067:0:10359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832082.704073:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832082.704075:0:10359:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788832082.704079:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1788832082.704354:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788832082.704380:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788832082.704393:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc800/0x998c12b283536fee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536ff5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832082.704414:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc800/0x998c12b283536fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536ff5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832082.704427:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788832082.704430:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d2c39185800 from 48 10000000:01000000:0.0:1788832082.704433:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788832082.704470:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8c00/0x998c12b283536ffc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832082.704477:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8c00/0x998c12b283536ffc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832082.704488:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8c00/0x998c12b283536ffc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832082.704508:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218355840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788832082.704672:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832082.704704:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832082.704847:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218355840 00000100:00100000:2.0:1788832082.704854:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218355840 00000100:00100000:2.0:1788832082.704895:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788832082.704902:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+19:6522:x1875726218355840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832082.704917:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832082.704944:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c092dde00/0x998c12b283537003 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283536ffc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832082.704970:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c092dde00/0x998c12b283537003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283536ffc expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832082.704980:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c092dde00/0x998c12b283537003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536ffc expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832082.704990:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dde00, rc 0) 00000100:00100000:2.0:1788832082.705028:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+20:6522:x1875726218355840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832082.705034:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788832082.706082:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218355840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832082.706108:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8c00/0x998c12b283536ffc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537003 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832082.706121:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8c00/0x998c12b283536ffc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283537003 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832082.706230:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218355968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832082.706281:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832082.706336:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832082.706496:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218355968 00000100:00100000:2.0:1788832082.706503:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218355968 00000100:00100000:2.0:1788832082.706753:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788832082.706772:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+20:6522:x1875726218355968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832082.707128:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+20:6522:x1875726218355968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 357us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832082.707137:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788832082.707480:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218355968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832082.707532:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218356096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832082.707602:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832082.707664:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788832082.707777:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218356096 00000100:00100000:1.0:1788832082.707785:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218356096 00000100:00100000:1.0:1788832082.707833:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788832082.707841:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+20:6522:x1875726218356096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788832082.708171:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+20:6522:x1875726218356096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 322us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832082.708186:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788832082.709902:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218356096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832082.711308:0:10360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10360:1875726218356224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832082.711418:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832082.711480:0:10360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788832082.711568:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218356224 00000100:00100000:2.0:1788832082.711577:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218356224 00000100:00100000:2.0:1788832082.711680:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788832082.711691:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+20:10360:x1875726218356224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832082.711910:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+20:10360:x1875726218356224:12345-0@lo:502:llog_process_th.0 Request processed in 220us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832082.711919:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788832082.712790:0:10360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10360:1875726218356224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832082.712889:0:10360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10360:1875726218356352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832082.712961:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832082.712997:0:10360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788832082.713094:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218356352 00000100:00100000:2.0:1788832082.713103:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218356352 00000100:00100000:2.0:1788832082.713226:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788832082.713238:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+20:10360:x1875726218356352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832082.713374:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+20:10360:x1875726218356352:12345-0@lo:502:llog_process_th.0 Request processed in 138us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832082.713382:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788832082.713780:0:10360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10360:1875726218356352:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788832082.713811:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788832082.714096:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788832082.714122:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788832082.714154:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8c00/0x998c12b283536ffc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537003 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.714165:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8c00/0x998c12b283536ffc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537003 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832082.714175:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788832082.714178:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1788832082.714181:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788832082.714457:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2000/0x998c12b28353700a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.714468:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2000/0x998c12b28353700a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.714478:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2000/0x998c12b28353700a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832082.714499:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218356480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788832082.714741:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832082.714810:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06589b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832082.714853:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218356480 00000100:00100000:0.0:1788832082.714860:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218356480 00000100:00100000:0.0:1788832082.714915:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788832082.714924:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+20:6522:x1875726218356480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832082.714938:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832082.714952:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c36db8a00/0x998c12b283537011 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b28353700a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832082.714976:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c36db8a00/0x998c12b283537011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b28353700a expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832082.715004:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c36db8a00/0x998c12b283537011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b28353700a expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832082.715057:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c36db8a00, rc 0) 00000100:00100000:0.0:1788832082.715153:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218356480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 231us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832082.715160:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788832082.715340:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218356480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788832082.715354:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2000/0x998c12b28353700a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537011 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.715364:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2000/0x998c12b28353700a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283537011 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832082.715419:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218356608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832082.715450:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832082.715500:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06589b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832082.715599:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218356608 00000100:00100000:0.0:1788832082.715603:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218356608 00000100:00100000:0.0:1788832082.715696:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788832082.715704:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218356608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832082.715859:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218356608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832082.715866:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788832082.715923:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218356608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832082.715952:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218356736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788832082.715990:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832082.716664:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06589b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832082.716735:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218356736 00000100:00100000:3.0:1788832082.716749:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218356736 00000100:00100000:3.0:1788832082.716837:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788832082.716848:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218356736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832082.717001:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218356736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832082.717009:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788832082.717114:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218356736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832082.717687:0:10361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10361:1875726218356864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832082.717727:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832082.717751:0:10361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788832082.717854:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218356864 00000100:00100000:2.0:1788832082.717868:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218356864 00000100:00100000:2.0:1788832082.717944:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788832082.717955:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+21:10361:x1875726218356864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832082.718520:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+21:10361:x1875726218356864:12345-0@lo:502:llog_process_th.0 Request processed in 564us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832082.718530:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788832082.718846:0:10361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10361:1875726218356864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788832082.718895:0:10361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832082.718909:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832082.718912:0:10361:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788832082.719085:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788832082.719130:0:10361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10361:1875726218356992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832082.719265:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832082.719313:0:10361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788832082.719404:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218356992 00000100:00100000:0.0:1788832082.719416:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218356992 00000100:00100000:0.0:1788832082.719479:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788832082.719492:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+21:10361:x1875726218356992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832082.719791:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+21:10361:x1875726218356992:12345-0@lo:502:llog_process_th.0 Request processed in 301us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832082.719799:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788832082.719853:0:10361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10361:1875726218356992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788832082.719883:0:10361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832082.719889:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832082.719891:0:10361:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788832082.719895:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1788832082.720026:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1788832082.720065:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788832082.720077:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2000/0x998c12b28353700a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537011 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.720089:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2000/0x998c12b28353700a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537011 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832082.720099:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788832082.720101:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d2c40623800 from 48 10000000:01000000:1.0:1788832082.720104:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788832082.720145:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3400/0x998c12b283537018 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.720153:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3400/0x998c12b283537018 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.720162:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3400/0x998c12b283537018 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832082.720181:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218357120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788832082.720224:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832082.720259:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06589b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832082.720272:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218357120 00000100:00100000:2.0:1788832082.720280:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218357120 00000100:00100000:2.0:1788832082.720326:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788832082.720334:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218357120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832082.720347:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832082.720363:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c092dd800/0x998c12b28353701f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283537018 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832082.720391:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c092dd800/0x998c12b28353701f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283537018 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832082.720403:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c092dd800/0x998c12b28353701f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283537018 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832082.720413:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dd800, rc 0) 00000100:00100000:2.0:1788832082.721338:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218357120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 999us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832082.721347:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788832082.724140:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218357120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788832082.724172:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3400/0x998c12b283537018 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353701f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.724185:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3400/0x998c12b283537018 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b28353701f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832082.724282:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218357248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832082.724359:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832082.724401:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06589b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832082.724651:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218357248 00000100:00100000:0.0:1788832082.724658:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218357248 00000100:00100000:0.0:1788832082.724771:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788832082.724781:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218357248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832082.725384:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218357248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 601us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832082.725392:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788832082.725484:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218357248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832082.725613:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218357376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788832082.725701:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832082.725743:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06589b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832082.725801:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218357376 00000100:00100000:2.0:1788832082.725815:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218357376 00000100:00100000:2.0:1788832082.725879:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788832082.725891:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218357376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832082.726079:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218357376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832082.726086:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788832082.726212:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218357376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832082.728879:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10362:1875726218357504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832082.729000:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832082.729057:0:10362:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c076d9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788832082.729073:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218357504 00000100:00100000:0.0:1788832082.729090:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218357504 00000100:00100000:0.0:1788832082.729393:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788832082.729405:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+22:10362:x1875726218357504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832082.729837:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+22:10362:x1875726218357504:12345-0@lo:502:llog_process_th.0 Request processed in 433us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832082.729846:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788832082.732816:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10362:1875726218357504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788832082.732910:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10362:1875726218357632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788832082.733479:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832082.733586:0:10362:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06589b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832082.733741:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218357632 00000100:00100000:0.0:1788832082.733749:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218357632 00000100:00100000:0.0:1788832082.733869:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788832082.733880:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+22:10362:x1875726218357632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832082.734177:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+22:10362:x1875726218357632:12345-0@lo:502:llog_process_th.0 Request processed in 298us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832082.734186:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788832082.734254:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10362:1875726218357632:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788832082.734279:0:10362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788832082.734721:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788832082.734743:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788832082.734754:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3400/0x998c12b283537018 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353701f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832082.734779:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3400/0x998c12b283537018 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353701f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832082.734789:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788832082.734792:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1788832082.734795:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788832082.734840:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3a00/0x998c12b283537026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832082.734848:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3a00/0x998c12b283537026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832082.734857:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3a00/0x998c12b283537026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832082.734878:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218357760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788832082.734918:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832082.743703:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788832082.743772:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218357760 00000100:00100000:1.0:1788832082.743797:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218357760 00000100:00100000:1.0:1788832082.743851:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788832082.743860:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218357760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788832082.743875:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832082.743892:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c390f2a00/0x998c12b28353702d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283537026 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.743919:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c390f2a00/0x998c12b28353702d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283537026 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.743929:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c390f2a00/0x998c12b28353702d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283537026 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.743938:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c390f2a00, rc 0) 00000100:00100000:1.0:1788832082.744009:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218357760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (9090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832082.744015:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788832082.744928:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218357760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832082.744948:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3a00/0x998c12b283537026 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353702d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832082.744971:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3a00/0x998c12b283537026 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b28353702d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832082.745054:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218357888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832082.745097:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832082.745133:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832082.745314:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218357888 00000100:00100000:0.0:1788832082.745319:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218357888 00000100:00100000:1.0:1788832082.745783:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788832082.745884:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218357888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832082.746157:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218357888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 364us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832082.746164:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788832082.746251:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218357888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832082.746293:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218358016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832082.746337:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832082.746375:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832082.746482:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218358016 00000100:00100000:2.0:1788832082.746488:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218358016 00000100:00100000:2.0:1788832082.746529:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788832082.746538:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218358016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832082.746687:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218358016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832082.746694:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788832082.746989:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218358016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832082.747391:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10363:1875726218358144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832082.747433:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832082.747465:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788832082.747471:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218358144 00000100:00100000:1.0:1788832082.747477:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218358144 00000100:00100000:1.0:1788832082.747642:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788832082.747652:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+23:10363:x1875726218358144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788832082.747759:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+23:10363:x1875726218358144:12345-0@lo:502:llog_process_th.0 Request processed in 109us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832082.747767:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788832082.747828:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10363:1875726218358144:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788832082.747854:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832082.747862:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832082.747864:0:10363:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788832082.747871:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788832082.747889:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10363:1875726218358272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832082.747922:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832082.747956:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788832082.747984:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218358272 00000100:00100000:1.0:1788832082.747989:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218358272 00000100:00100000:1.0:1788832082.748053:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788832082.748060:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+23:10363:x1875726218358272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788832082.748131:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+23:10363:x1875726218358272:12345-0@lo:502:llog_process_th.0 Request processed in 72us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832082.748138:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788832082.748249:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10363:1875726218358272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788832082.748278:0:10363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832082.748283:0:10363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832082.748285:0:10363:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788832082.748289:0:10363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788832082.748361:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1788832082.748389:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788832082.748399:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3a00/0x998c12b283537026 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353702d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.748410:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3a00/0x998c12b283537026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353702d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832082.748420:0:6522:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788832082.748423:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d2c18e319b8 from 1 10000000:01000000:1.0:1788832082.748426:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788832082.748447:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283537034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.748455:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283537034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.748464:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283537034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832082.748484:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218358400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788832082.748663:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832082.748681:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b065893c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832082.748785:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218358400 00000100:00100000:2.0:1788832082.748791:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218358400 00000100:00100000:2.0:1788832082.748824:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788832082.748832:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218358400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832082.748842:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832082.748854:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c092dd000/0x998c12b28353703b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283537034 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832082.748874:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c092dd000/0x998c12b28353703b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283537034 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832082.748884:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c092dd000/0x998c12b28353703b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283537034 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832082.748892:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dd000, rc 0) 00000100:00100000:2.0:1788832082.748931:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:6522:x1875726218358400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832082.748937:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788832082.749027:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218358400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788832082.749039:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283537034 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353703b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832082.749048:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283537034 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b28353703b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832082.749097:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218358528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832082.749122:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832082.749149:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b065893c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832082.749195:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218358528 00000100:00100000:2.0:1788832082.749200:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218358528 00000100:00100000:2.0:1788832082.749258:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788832082.749265:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:6522:x1875726218358528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832082.749347:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:6522:x1875726218358528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (223us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788832082.749354:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788832082.749410:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218358528:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788832082.749433:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788832082.749439:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283537034 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353703b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832082.749458:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283537034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353703b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832083.414993:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832083.604556:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832083.607237:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202574464 00000100:00100000:0.0:1788832083.607314:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202574464 00000100:00100000:0.0:1788832083.607410:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 241 00000100:00100000:0.0:1788832083.607423:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+8:6168:x1875726202574464:12345-192.168.203.26@tcp:101: 00010000:00010000:0.0:1788832083.607446:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832083.607474:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c36db8800/0x998c12b283537042 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0455a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832083.607557:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c36db8800/0x998c12b283537042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0455a expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832083.607573:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c36db8800/0x998c12b283537042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0455a expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832083.607584:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c36db8800, rc 0) 00000100:00100000:0.0:1788832083.608174:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+9:6168:x1875726202574464:12345-192.168.203.26@tcp:101: Request processed in 748us (3638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832083.608184:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 241 00000100:00100000:2.0:1788832083.613608:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832083.613912:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202574592 00000100:00100000:0.0:1788832083.613925:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202574592 00000100:00100000:0.0:1788832083.614005:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 242 00000100:00100000:0.0:1788832083.614017:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+9:6168:x1875726202574592:12345-192.168.203.26@tcp:501: 00000100:00100000:0.0:1788832083.614588:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+9:6168:x1875726202574592:12345-192.168.203.26@tcp:501: Request processed in 569us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832083.614598:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 242 00000100:00100000:2.0:1788832083.620019:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832083.620294:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202574720 00000100:00100000:0.0:1788832083.620306:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202574720 00000100:00100000:0.0:1788832083.620375:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 243 00000100:00100000:0.0:1788832083.620387:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+9:6168:x1875726202574720:12345-192.168.203.26@tcp:503: 00000100:00100000:0.0:1788832083.620586:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+9:6168:x1875726202574720:12345-192.168.203.26@tcp:503: Request processed in 201us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832083.620595:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 243 00000100:00100000:2.0:1788832083.630823:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832083.631215:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202574848 00000100:00100000:1.0:1788832083.631229:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202574848 00000100:00100000:1.0:1788832083.631314:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 244 00000100:00100000:1.0:1788832083.631325:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+9:6658:x1875726202574848:12345-192.168.203.26@tcp:502: 00000100:00100000:1.0:1788832083.631538:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+9:6658:x1875726202574848:12345-192.168.203.26@tcp:502: Request processed in 213us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832083.631556:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 244 00000100:00100000:1.0:1788832083.643124:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832083.643287:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202574976 00000100:00100000:2.0:1788832083.643302:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202574976 00000100:00100000:2.0:1788832083.643380:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 245 00000100:00100000:2.0:1788832083.643392:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+9:6658:x1875726202574976:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788832083.643655:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+9:6658:x1875726202574976:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 229us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832083.643666:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 245 00000100:00100000:2.0:1788832083.646792:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832083.653198:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202575104 00000100:00100000:0.0:1788832083.653243:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202575104 00000100:00100000:0.0:1788832083.653331:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 246 00000100:00100000:0.0:1788832083.653343:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+9:6168:x1875726202575104:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832083.653365:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832083.653393:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c36db8000/0x998c12b283537049 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04561 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832083.653435:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c36db8000/0x998c12b283537049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04561 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832083.653449:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c36db8000/0x998c12b283537049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04561 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832083.653460:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c36db8000, rc 0) 00000100:00100000:0.0:1788832083.653575:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+10:6168:x1875726202575104:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 234us (6794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832083.653582:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 246 00000100:00100000:3.0:1788832083.660352:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832083.660563:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202575232 00000100:00100000:1.0:1788832083.660577:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202575232 00000100:00100000:1.0:1788832083.660701:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 247 00000100:00100000:1.0:1788832083.660734:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+10:6168:x1875726202575232:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832083.660903:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+10:6168:x1875726202575232:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 173us (567us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788832083.660912:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 247 00000100:00100000:2.0:1788832083.671645:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832083.671679:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218358656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832083.671775:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832083.671988:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218358656 00000100:00100000:3.0:1788832083.671998:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218358656 00000100:00100000:3.0:1788832083.672067:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788832083.672080:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218358656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788832083.672124:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788832083.672195:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218358656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832083.672204:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788832083.672379:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218358656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788832084.186260:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788832084.186289:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218358784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788832084.186407:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832084.187361:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218358784 00000100:00100000:3.0:1788832084.187373:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218358784 00000100:00100000:3.0:1788832084.187440:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788832084.187451:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218358784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788832084.187485:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788832084.187591:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218358784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 142us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832084.187599:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788832084.188289:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218358784:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788832084.439241:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832084.699657:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218358912:0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.699749:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832084.699803:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1875726218359424:0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.699848:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832084.699876:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1875726218359936:0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.699898:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832084.699920:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788832084.699926:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218359296:0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.699950:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832084.699968:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218359808:0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.699989:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832084.700005:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218360320:0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.700025:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832084.700053:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875726218359168:0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.700076:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832084.700094:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218359680:0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.700114:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832084.700129:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218360192:0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.700146:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832084.700178:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788832084.700183:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875726218359040:0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.700204:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832084.700221:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218359552:0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.700240:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832084.700680:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218360064:0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.700758:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832084.700790:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218359424 00000100:00100000:3.0:1788832084.700798:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218359424 00000100:00100000:3.0:1788832084.700845:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218359936 00000100:00100000:3.0:1788832084.700864:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218359936 00000100:00100000:3.0:1788832084.700883:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218359168 00000100:00100000:3.0:1788832084.700885:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218359168 00000100:00100000:3.0:1788832084.700896:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218359040 00000100:00100000:3.0:1788832084.700899:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218359040 00000100:00100000:3.0:1788832084.700908:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218359552 00000100:00100000:3.0:1788832084.700910:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218359552 00000100:00100000:3.0:1788832084.700921:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218360064 00000100:00100000:3.0:1788832084.700923:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218360064 00000100:00100000:3.0:1788832084.700939:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788832084.700947:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875726218359424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.701002:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875726218359424:12345-0@lo:400:kworker.0 Request processed in 55us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832084.701010:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788832084.701029:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788832084.701035:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875726218359936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.701063:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875726218359936:12345-0@lo:400:kworker.0 Request processed in 29us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832084.701069:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788832084.701080:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788832084.701085:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875726218359168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.701115:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875726218359168:12345-0@lo:400:kworker.0 Request processed in 30us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832084.701120:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788832084.704330:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218358912 00000100:00100000:2.0:1788832084.704345:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218358912 00000100:00100000:2.0:1788832084.704406:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788832084.704417:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:3652:x1875726218358912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832084.704499:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:3652:x1875726218358912:12345-0@lo:400:kworker.0 Request processed in 84us (4750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832084.704523:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788832084.705751:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788832084.705777:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875726218359040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.705852:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875726218359040:12345-0@lo:400:kworker.0 Request processed in 86us (5646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832084.705874:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788832084.705902:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788832084.705910:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218359552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.705945:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218359552:12345-0@lo:400:kworker.0 Request processed in 36us (5703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832084.705951:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788832084.705962:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788832084.705969:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218360064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.705997:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218360064:12345-0@lo:400:kworker.0 Request processed in 29us (5238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832084.706002:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788832084.706064:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218359296 00000100:00100000:3.0:1788832084.706071:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218359296 00000100:00100000:3.0:1788832084.706119:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788832084.706125:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218359296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.706160:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218359296:12345-0@lo:400:kworker.0 Request processed in 35us (6208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832084.706166:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788832084.706186:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218359808 00000100:00100000:3.0:1788832084.706190:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218359808 00000100:00100000:3.0:1788832084.706220:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218360320 00000100:00100000:3.0:1788832084.706224:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218360320 00000100:00100000:3.0:1788832084.706235:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218359680 00000100:00100000:3.0:1788832084.706238:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218359680 00000100:00100000:3.0:1788832084.706248:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218360192 00000100:00100000:3.0:1788832084.706251:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218360192 00000100:00100000:3.0:1788832084.706265:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788832084.706278:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218359808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.706310:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218359808:12345-0@lo:400:kworker.0 Request processed in 32us (6319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832084.706317:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788832084.706328:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788832084.706334:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218360320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.706380:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218360320:12345-0@lo:400:kworker.0 Request processed in 45us (6353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832084.706386:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788832084.706398:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788832084.706403:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218359680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.706430:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218359680:12345-0@lo:400:kworker.0 Request processed in 27us (6315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832084.706436:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788832084.706447:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788832084.706453:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218360192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.706478:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218360192:12345-0@lo:400:kworker.0 Request processed in 26us (6331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832084.706484:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788832084.706521:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788832084.706525:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788832084.706528:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788832084.706530:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832084.706589:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875726218359040:0@lo:400:kworker.0 00010000:00080000:3.0:1788832084.706604:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c1fe25180 x1875726218359552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832084.706652:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218359552:0@lo:400:kworker.0 00010000:00080000:3.0:1788832084.706666:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c18fe7100 x1875726218360064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832084.706673:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218360064:0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.706685:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875726218359168:0@lo:400:kworker.0 00010000:00080000:3.0:1788832084.706695:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c1fe26300 x1875726218359680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832084.706703:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218359680:0@lo:400:kworker.0 00010000:00080000:3.0:1788832084.706714:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c18fe4e00 x1875726218360192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832084.706722:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218360192:0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.706770:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218359296:0@lo:400:kworker.0 00010000:00080000:3.0:1788832084.706780:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c1fe24a80 x1875726218359808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832084.706788:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218359808:0@lo:400:kworker.0 00010000:00080000:3.0:1788832084.706797:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c18fe4700 x1875726218360320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832084.706805:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218360320:0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.706815:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218358912:0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.706827:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1875726218359424:0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.706846:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1875726218359936:0@lo:400:kworker.0 00000100:00100000:3.0:1788832084.706941:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b074f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218360448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832084.706996:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832084.707044:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218360448 00000100:00100000:3.0:1788832084.707049:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218360448 00000100:00100000:3.0:1788832084.707077:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788832084.707085:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218360448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788832084.707106:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832084.707143:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218360448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832084.707150:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788832084.707183:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b074f4000 x1875726218360448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832084.707195:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b074f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218360448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832085.207247:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b074f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218360576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788832085.207324:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832085.207449:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218360576 00000100:00100000:3.0:1788832085.207459:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218360576 00000100:00100000:3.0:1788832085.207526:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788832085.207543:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218360576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788832085.207569:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832085.207645:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218360576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832085.207653:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788832085.207697:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b074f4000 x1875726218360576/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832085.207717:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b074f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218360576:0@lo:13:osp-pre-1-1.0 00000020:00000080:3.0:1788832085.232208:0:10400:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd15705d60 20000000:00000080:3.0:1788832085.232230:0:10400:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d2b0768b000 uarg=0000000000000000 20000000:01000000:3.0:1788832085.232275:0:10400:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788832085.232282:0:10400:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788832085.232286:0:10400:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788832085.235616:0:10401:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788832085.235992:0:10400:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788832085.240397:0:10400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788832085.240433:0:10400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788832085.240447:0:10400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788832085.240475:0:10400:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788832085.240495:0:10400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d2c36db8200/0x998c12b283537050 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.240544:0:10400:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c00030a00/0x998c12b283536c98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536c91 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.240552:0:10400:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c00031000/0x998c12b283536cec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536ce5 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.240559:0:10400:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c421d3600/0x998c12b283536d4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536d47 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.240566:0:10400:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283536e6d expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.240576:0:10400:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c092dd200/0x998c12b283536f8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04522 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.240583:0:10400:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d2c36db8200/0x998c12b283537050 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.240638:0:10400:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c092dd200/0x998c12b283536f8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04522 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.240654:0:10400:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2c092dd200/0x998c12b283536f8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04522 expref: 9 pid: 6518 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832085.240668:0:10400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10400:1875726218360704:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788832085.240772:0:10400:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536e6d expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.240791:0:10400:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536e6d expref: 23 pid: 6519 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832085.240799:0:10400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10400:1875726218360832:0@lo:104: 00000100:00100000:0.0:1788832085.240839:0:10400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832085.240880:0:10400:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c421d3600/0x998c12b283536d4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536d47 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.240889:0:10400:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c421d3600/0x998c12b283536d4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536d47 expref: 23 pid: 6518 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832085.240897:0:10400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10400:1875726218360960:0@lo:104: 00000100:00100000:0.0:1788832085.240923:0:10400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832085.240944:0:10400:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c00031000/0x998c12b283536cec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536ce5 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.240952:0:10400:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c00031000/0x998c12b283536cec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536ce5 expref: 23 pid: 6517 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832085.240959:0:10400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10400:1875726218361088:0@lo:104: 00010000:00010000:0.0:1788832085.240982:0:10400:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c00030a00/0x998c12b283536c98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283536c91 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.240990:0:10400:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c00030a00/0x998c12b283536c98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283536c91 expref: 23 pid: 6517 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832085.240998:0:10400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10400:1875726218361216:0@lo:104: 00000100:00100000:0.0:1788832085.241016:0:10400:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032f6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832085.241453:0:6508:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788832085.241472:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832085.241483:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832085.241491:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218360832 00000100:00100000:2.0:1788832085.241497:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218360832 00000100:00100000:2.0:1788832085.241557:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218360960 00000100:00100000:2.0:1788832085.241561:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218360960 00000100:00100000:2.0:1788832085.241573:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218361088 00000100:00100000:2.0:1788832085.241576:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218361088 00000100:00100000:2.0:1788832085.241583:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218361216 00000100:00100000:2.0:1788832085.241585:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218361216 00000100:00100000:2.0:1788832085.241597:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788832085.241606:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+6:10400:x1875726218360832:12345-0@lo:104: 00010000:00010000:2.0:1788832085.241656:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536e6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536e74 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.241712:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788832085.241719:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+6:10400:x1875726218360832:12345-0@lo:104: Request processed in 114us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832085.241726:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788832085.241745:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788832085.241753:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0677a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+5:10400:x1875726218360960:12345-0@lo:104: 00010000:00010000:2.0:1788832085.241760:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b283536d47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536d4e expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.241792:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788832085.241798:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0677a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+5:10400:x1875726218360960:12345-0@lo:104: Request processed in 47us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832085.241815:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788832085.241843:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788832085.241848:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+4:10400:x1875726218361088:12345-0@lo:104: 00010000:00010000:2.0:1788832085.241855:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2800/0x998c12b283536ce5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536cec expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.241883:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788832085.241888:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+4:10400:x1875726218361088:12345-0@lo:104: Request processed in 40us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832085.241894:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788832085.241905:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788832085.241910:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+3:10400:x1875726218361216:12345-0@lo:104: 00010000:00010000:2.0:1788832085.241917:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c4204b000/0x998c12b283536c91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536c98 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.241942:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788832085.241947:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+3:10400:x1875726218361216:12345-0@lo:104: Request processed in 37us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832085.241953:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1788832085.241970:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788832085.241976:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536e6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536e74 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.241984:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c390f2400 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832085.241989:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536e6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536e74 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.242009:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536e6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536e74 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832085.242016:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536e6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536e74 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832085.242022:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788832085.242073:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536e6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536e74 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.242080:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832085.242101:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536e6d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536e74 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832085.242108:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218361344:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788832085.242108:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2400/0x998c12b283536e6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536e74 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832085.242151:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788832085.242309:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788832085.242314:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b283536d47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536d4e expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.242320:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c390f2600 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832085.242322:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b283536d47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536d4e expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.242328:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b283536d47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536d4e expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832085.242333:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b283536d47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536d4e expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832085.242346:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788832085.242372:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b283536d47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536d4e expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.242378:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832085.242395:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b283536d47 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536d4e expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.242402:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b283536d47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536d4e expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.242412:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788832085.242414:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2800/0x998c12b283536ce5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536cec expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.242419:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c390f2800 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832085.242421:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2800/0x998c12b283536ce5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536cec expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.242428:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2800/0x998c12b283536ce5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536cec expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832085.242433:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2800/0x998c12b283536ce5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536cec expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832085.242437:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788832085.242449:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2800/0x998c12b283536ce5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536cec expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.242454:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832085.242467:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2800/0x998c12b283536ce5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536cec expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.242472:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2800/0x998c12b283536ce5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536cec expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.242481:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832085.242484:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c4204b000/0x998c12b283536c91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283536c98 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.242490:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c4204b000 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832085.242493:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c4204b000/0x998c12b283536c91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283536c98 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.242498:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c4204b000/0x998c12b283536c91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283536c98 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832085.242504:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c4204b000/0x998c12b283536c91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283536c98 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832085.242510:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788832085.242774:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c4204b000/0x998c12b283536c91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536c98 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.242781:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832085.242794:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c4204b000/0x998c12b283536c91 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536c98 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.242800:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c4204b000/0x998c12b283536c91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283536c98 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.242814:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832085.242822:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832085.242824:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832085.242832:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832085.242844:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218361728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832085.242878:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832085.242916:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218361472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832085.242939:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832085.242959:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832085.242964:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218361600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832085.242986:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832085.243016:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218361344 00000100:00100000:2.0:1788832085.243023:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218361344 00000100:00100000:0.0:1788832085.243349:0:10400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10400:1875726218360832:0@lo:104: 00000100:00100000:0.0:1788832085.243360:0:10400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10400:1875726218360960:0@lo:104: 00000100:00100000:0.0:1788832085.243367:0:10400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10400:1875726218361088:0@lo:104: 00000100:00100000:0.0:1788832085.243374:0:10400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10400:1875726218361216:0@lo:104: 00010000:00010000:2.0:1788832085.243431:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536e6d expref: 24 pid: 6519 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832085.243464:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218361728 00000100:00100000:2.0:1788832085.243467:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218361728 00010000:00010000:2.0:1788832085.243479:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c00030a00/0x998c12b283536c98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536c91 expref: 25 pid: 6517 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832085.243550:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218361472 00000100:00100000:2.0:1788832085.243554:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218361472 00010000:00010000:2.0:1788832085.243565:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c421d3600/0x998c12b283536d4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536d47 expref: 26 pid: 6518 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832085.247758:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218361600 00000100:00100000:0.0:1788832085.247774:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218361600 00010000:00010000:0.0:1788832085.247818:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c00031000/0x998c12b283536cec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536ce5 expref: 27 pid: 6517 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832085.247851:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788832085.247860:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e55f0905-9d39-4464-9830-326b420fb582+27:3654:x1875726218361344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832085.247874:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832085.247880:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536e6d expref: 27 pid: 6519 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.247891:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536e6d expref: 27 pid: 6519 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.247910:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c421d3e00/0x998c12b283536e74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536e6d expref: 27 pid: 6519 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.247927:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832085.247998:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e55f0905-9d39-4464-9830-326b420fb582+26:3654:x1875726218361344:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (5845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832085.248005:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788832085.248024:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788832085.248031:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07655f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e55f0905-9d39-4464-9830-326b420fb582+25:3653:x1875726218361728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832085.248038:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832085.248056:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c00030a00/0x998c12b283536c98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536c91 expref: 25 pid: 6517 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.248065:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c00030a00/0x998c12b283536c98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536c91 expref: 25 pid: 6517 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.248075:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c00030a00/0x998c12b283536c98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536c91 expref: 25 pid: 6517 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.248084:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832085.248190:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07655f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e55f0905-9d39-4464-9830-326b420fb582+24:3653:x1875726218361728:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (5238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832085.248197:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788832085.248212:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788832085.248219:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07657b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e55f0905-9d39-4464-9830-326b420fb582+23:3651:x1875726218361472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832085.248228:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832085.248233:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c421d3600/0x998c12b283536d4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536d47 expref: 23 pid: 6518 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.248241:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c421d3600/0x998c12b283536d4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536d47 expref: 23 pid: 6518 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.248251:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c421d3600/0x998c12b283536d4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536d47 expref: 23 pid: 6518 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.248260:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832085.248290:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07657b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e55f0905-9d39-4464-9830-326b420fb582+22:3651:x1875726218361472:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (5350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832085.248296:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788832085.248309:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788832085.248322:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18e26050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e55f0905-9d39-4464-9830-326b420fb582+21:3651:x1875726218361600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832085.248330:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832085.248334:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c00031000/0x998c12b283536cec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283536ce5 expref: 21 pid: 6517 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.248341:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c00031000/0x998c12b283536cec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283536ce5 expref: 21 pid: 6517 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.248350:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c00031000/0x998c12b283536cec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283536ce5 expref: 21 pid: 6517 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.248358:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832085.248380:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18e26050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e55f0905-9d39-4464-9830-326b420fb582+20:3651:x1875726218361600:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (5393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832085.248384:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788832085.248837:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218361728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832085.250449:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218361344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832085.250497:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218361600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832085.250724:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218361472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788832085.250916:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832085.250980:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202575360 00000100:00100000:1.0:1788832085.250987:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202575360 00010000:00010000:1.0:1788832085.251021:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c092dd200/0x998c12b283536f8c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04522 expref: 10 pid: 6518 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832085.251062:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:1.0:1788832085.251072:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:229a6744-cc0e-4765-812a-1d39bc7df2da+10:2394:x1875726202575360:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832085.251085:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832085.251090:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c092dd200/0x998c12b283536f8c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04522 expref: 10 pid: 6518 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832085.251101:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c092dd200/0x998c12b283536f8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04522 expref: 10 pid: 6518 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832085.251196:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d2c36db8200/0x998c12b283537050 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832085.251206:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c36db8200/0x998c12b283537050 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832085.251223:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c36db8200/0x998c12b283537050 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832085.251230:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c36db8200/0x998c12b283537050 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832085.251249:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d2c36db8200/0x998c12b283537050 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832085.251256:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d2c36db8200/0x998c12b283537050 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832085.251263:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c36db8200 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:1.0:1788832085.251268:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d2c36db8200/0x998c12b283537050 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832085.251277:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d2c36db8200/0x998c12b283537050 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832085.251286:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d2c36db8200/0x998c12b283537050 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832085.251295:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832085.251357:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:229a6744-cc0e-4765-812a-1d39bc7df2da+10:2394:x1875726202575360:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 287us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832085.251364:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 39 00010000:00010000:0.0:1788832085.251454:0:10400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c092dd200/0x998c12b283536f8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04522 expref: 9 pid: 6518 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832085.251467:0:10400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10400:1875726218360704:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788832085.251497:0:10400:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d2c36db8200/0x998c12b283537050 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.251583:0:10400:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d2c36db8200/0x998c12b283537050 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.251591:0:10400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d2c36db8200/0x998c12b283537050 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832085.251598:0:10400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c36db8200/0x998c12b283537050 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832085.463420:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832085.718989:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788832085.719013:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218361856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788832085.719083:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832085.719191:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218361856 00000100:00100000:2.0:1788832085.719200:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218361856 00000100:00100000:2.0:1788832085.719270:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788832085.719279:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218361856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788832085.719311:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788832085.719354:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218361856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832085.719361:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788832085.719613:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07656a00 x1875726218361856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832085.719662:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218361856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788832086.231969:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788832086.231999:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218361984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788832086.232067:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832086.232142:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218361984 00000100:00100000:1.0:1788832086.232149:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218361984 00000100:00100000:1.0:1788832086.232211:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788832086.232226:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218361984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832086.232271:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832086.232333:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218361984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832086.232341:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788832086.232398:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36d0c380 x1875726218361984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832102 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832086.232419:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218361984:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788832086.232585:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:3.0:1788832086.486800:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788832086.486807:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2c3fcaa000 from 4 10000000:01000000:3.0:1788832086.486811:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788832086.486853:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b283537057 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832086.486863:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b283537057 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832086.486873:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b283537057 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832086.486897:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b074f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218362112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788832086.486962:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832086.487088:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788832086.487416:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218362112 00000100:00100000:2.0:1788832086.487424:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218362112 00000100:00100000:2.0:1788832086.487492:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788832086.487504:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+20:6522:x1875726218362112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832086.487517:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832086.487544:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c092dc200/0x998c12b28353705e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283537057 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.487571:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c092dc200/0x998c12b28353705e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283537057 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.487584:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c092dc200/0x998c12b28353705e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283537057 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.487594:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dc200, rc 0) 00000100:00100000:2.0:1788832086.487683:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218362112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832086.487702:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00010000:00010000:2.0:1788832086.487869:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832086.487970:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b074f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218362112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832086.487987:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b283537057 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353705e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832086.488009:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b283537057 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b28353705e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832086.488080:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b074f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218362240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832086.488115:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832086.488582:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788832086.488724:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218362240 00000100:00100000:2.0:1788832086.488730:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218362240 00000100:00100000:2.0:1788832086.488773:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788832086.488784:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218362240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.488936:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218362240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832086.488944:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788832086.489795:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b074f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218362240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832086.489853:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218362368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832086.489904:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832086.489943:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0304e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788832086.491906:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218362368 00000100:00100000:2.0:1788832086.491919:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218362368 00000100:00100000:2.0:1788832086.491966:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788832086.492791:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218362368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.492969:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218362368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 993us (3062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832086.493054:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788832086.493440:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218362368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832086.494251:0:10456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10456:1875726218362496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832086.494320:0:10456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832086.494366:0:10456:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0304ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832086.494799:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218362496 00000100:00100000:2.0:1788832086.494807:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218362496 00000100:00100000:2.0:1788832086.494864:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788832086.494877:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+21:10456:x1875726218362496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832086.496572:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+21:10456:x1875726218362496:12345-0@lo:502:llog_process_th.0 Request processed in 1689us (2244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832086.496585:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788832086.502894:0:10456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10456:1875726218362496:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788832086.502947:0:10456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832086.502960:0:10456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832086.502963:0:10456:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788832086.502992:0:10456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d2c3fcaa000 00000020:00000080:1.0:1788832086.502999:0:10456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788832086.504839:0:10456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10456:1875726218362624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832086.504982:0:10456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832086.505079:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218362624 00000100:00100000:2.0:1788832086.505090:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218362624 00000100:00100000:2.0:1788832086.505164:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788832086.505178:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+21:10456:x1875726218362624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832086.505349:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+21:10456:x1875726218362624:12345-0@lo:502:llog_process_th.0 Request processed in 175us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832086.505358:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788832086.505426:0:10456:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0760fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832086.505457:0:10456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10456:1875726218362624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832086.505501:0:10456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832086.505513:0:10456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832086.505516:0:10456:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788832086.505536:0:10456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788832086.505704:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788832086.505751:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788832086.505765:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b283537057 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353705e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.505779:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b283537057 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353705e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832086.505793:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788832086.505797:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2c3e677800 from 4 10000000:01000000:2.0:1788832086.505800:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788832086.505841:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dda00/0x998c12b283537065 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.505851:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c092dda00/0x998c12b283537065 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.505876:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c092dda00/0x998c12b283537065 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832086.505896:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218362752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.505943:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832086.505970:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0760fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832086.505995:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218362752 00000100:00100000:2.0:1788832086.506001:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218362752 00000100:00100000:2.0:1788832086.506049:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788832086.506059:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218362752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832086.506071:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832086.506087:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c092ddc00/0x998c12b28353706c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283537065 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.506118:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c092ddc00/0x998c12b28353706c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283537065 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.506131:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c092ddc00/0x998c12b28353706c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283537065 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.506142:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092ddc00, rc 0) 00000100:00100000:2.0:1788832086.506179:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218362752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832086.506186:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788832086.506234:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218362752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832086.506250:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c092dda00/0x998c12b283537065 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353706c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.506269:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dda00/0x998c12b283537065 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b28353706c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832086.506346:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218362880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.506384:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832086.506402:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0760fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832086.506415:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218362880 00000100:00100000:2.0:1788832086.506419:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218362880 00000100:00100000:2.0:1788832086.506445:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788832086.506452:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218362880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.506583:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218362880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832086.506592:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788832086.506660:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218362880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.506697:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218363008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.506748:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832086.506762:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0760fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832086.506777:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218363008 00000100:00100000:2.0:1788832086.506781:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218363008 00000100:00100000:2.0:1788832086.506805:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788832086.506812:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218363008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.506898:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218363008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832086.506905:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788832086.506958:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218363008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.516290:0:10460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10460:1875726218363136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832086.516377:0:10460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832086.517111:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218363136 00000100:00100000:2.0:1788832086.517120:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218363136 00000100:00100000:2.0:1788832086.517170:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788832086.517179:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+22:10460:x1875726218363136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832086.517300:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+22:10460:x1875726218363136:12345-0@lo:502:llog_process_th.0 Request processed in 122us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832086.517307:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788832086.517360:0:10460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c076d99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832086.517384:0:10460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10460:1875726218363136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832086.521195:0:10460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832086.521211:0:10460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832086.521214:0:10460:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788832086.521223:0:10460:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d2c3e677800 00000020:00000080:2.0:1788832086.521226:0:10460:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788832086.521341:0:10460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10460:1875726218363264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832086.521428:0:10460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832086.521465:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218363264 00000100:00100000:2.0:1788832086.521471:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218363264 00000100:00100000:2.0:1788832086.521519:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788832086.521539:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+22:10460:x1875726218363264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832086.521669:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+22:10460:x1875726218363264:12345-0@lo:502:llog_process_th.0 Request processed in 131us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832086.521677:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788832086.521735:0:10460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c184449c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832086.521767:0:10460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10460:1875726218363264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832086.521788:0:10460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832086.521792:0:10460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832086.521794:0:10460:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788832086.521797:0:10460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788832086.521854:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788832086.521873:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788832086.521883:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dda00/0x998c12b283537065 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353706c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.521894:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c092dda00/0x998c12b283537065 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353706c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832086.521904:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788832086.521907:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2c39185800 from 4 10000000:01000000:2.0:1788832086.521909:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788832086.521936:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd200/0x998c12b283537073 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.521944:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd200/0x998c12b283537073 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.521953:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd200/0x998c12b283537073 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832086.521966:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218363392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.521992:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832086.522007:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c184449c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832086.522021:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218363392 00000100:00100000:2.0:1788832086.522029:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218363392 00000100:00100000:2.0:1788832086.522052:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788832086.522058:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218363392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832086.522066:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832086.522077:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c092dc400/0x998c12b28353707a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283537073 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.522097:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c092dc400/0x998c12b28353707a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283537073 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.522108:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c092dc400/0x998c12b28353707a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283537073 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.522116:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dc400, rc 0) 00000100:00100000:2.0:1788832086.522142:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218363392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832086.522148:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788832086.522177:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218363392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832086.522188:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd200/0x998c12b283537073 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353707a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.522196:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd200/0x998c12b283537073 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b28353707a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832086.522238:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218363520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.522261:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832086.522273:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c184449c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832086.522284:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218363520 00000100:00100000:2.0:1788832086.522293:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218363520 00000100:00100000:2.0:1788832086.522315:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788832086.522321:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218363520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.522416:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218363520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832086.522423:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788832086.522451:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218363520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.522477:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218363648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.522509:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832086.522534:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c184449c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832086.522546:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218363648 00000100:00100000:2.0:1788832086.522549:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218363648 00000100:00100000:2.0:1788832086.522569:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788832086.522575:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218363648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.522660:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218363648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832086.522666:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788832086.522702:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218363648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.522935:0:10461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10461:1875726218363776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832086.522970:0:10461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832086.522988:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218363776 00000100:00100000:2.0:1788832086.522991:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218363776 00000100:00100000:2.0:1788832086.523010:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788832086.523016:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+23:10461:x1875726218363776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832086.523078:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+23:10461:x1875726218363776:12345-0@lo:502:llog_process_th.0 Request processed in 61us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832086.523091:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788832086.523119:0:10461:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36de8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788832086.523131:0:10461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10461:1875726218363776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832086.523153:0:10461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832086.523160:0:10461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832086.523163:0:10461:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788832086.523168:0:10461:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d2c39185800 00000020:00000080:2.0:1788832086.523171:0:10461:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788832086.523226:0:10461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10461:1875726218363904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832086.523258:0:10461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832086.523275:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218363904 00000100:00100000:2.0:1788832086.523278:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218363904 00000100:00100000:2.0:1788832086.523297:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788832086.523302:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+23:10461:x1875726218363904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832086.523356:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+23:10461:x1875726218363904:12345-0@lo:502:llog_process_th.0 Request processed in 53us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832086.523363:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788832086.523390:0:10461:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36de8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788832086.523403:0:10461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10461:1875726218363904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832086.523419:0:10461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832086.523423:0:10461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832086.523425:0:10461:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788832086.523428:0:10461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788832086.523466:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788832086.523482:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788832086.523490:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd200/0x998c12b283537073 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353707a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.523505:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd200/0x998c12b283537073 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353707a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832086.523513:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788832086.523516:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2c40623800 from 4 10000000:01000000:2.0:1788832086.523519:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788832086.542804:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283537081 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.542826:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283537081 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.542839:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283537081 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832086.542872:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218364032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.542946:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832086.544028:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218364032 00000100:00100000:2.0:1788832086.544038:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218364032 00000100:00100000:2.0:1788832086.544087:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788832086.544098:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218364032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832086.544117:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832086.544133:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c092dca00/0x998c12b283537088 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283537081 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.544162:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c092dca00/0x998c12b283537088 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283537081 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.544176:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c092dca00/0x998c12b283537088 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283537081 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.544194:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dca00, rc 0) 00000100:00100000:2.0:1788832086.544256:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:6522:x1875726218364032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832086.544263:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788832086.544311:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36de8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788832086.544336:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218364032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832086.544351:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283537081 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537088 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.544361:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283537081 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283537088 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832086.544433:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218364160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.544464:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832086.544486:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218364160 00000100:00100000:2.0:1788832086.544490:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218364160 00000100:00100000:2.0:1788832086.544515:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788832086.544537:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:6522:x1875726218364160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.545862:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:6522:x1875726218364160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1335us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832086.545872:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788832086.545926:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36de8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788832086.545949:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218364160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.546066:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218364288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.546125:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832086.546153:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218364288 00000100:00100000:2.0:1788832086.546159:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218364288 00000100:00100000:2.0:1788832086.546193:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788832086.546202:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:6522:x1875726218364288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.546292:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:6522:x1875726218364288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832086.546298:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788832086.546330:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36de8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788832086.546343:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218364288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832086.546553:0:10466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10466:1875726218364416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832086.546588:0:10466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832086.546605:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218364416 00000100:00100000:2.0:1788832086.546608:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218364416 00000100:00100000:2.0:1788832086.546657:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788832086.549065:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:10466:x1875726218364416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832086.549260:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:10466:x1875726218364416:12345-0@lo:502:llog_process_th.0 Request processed in 2594us (2668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832086.549271:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788832086.549349:0:10466:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36de83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832086.549375:0:10466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10466:1875726218364416:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832086.549409:0:10466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832086.549418:0:10466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832086.549421:0:10466:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788832086.549428:0:10466:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d2c40623800 00000020:00000080:2.0:1788832086.549435:0:10466:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788832086.549842:0:10466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10466:1875726218364544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832086.549885:0:10466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832086.549912:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218364544 00000100:00100000:2.0:1788832086.549920:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218364544 00000100:00100000:2.0:1788832086.549952:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788832086.549960:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:10466:x1875726218364544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832086.550037:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:10466:x1875726218364544:12345-0@lo:502:llog_process_th.0 Request processed in 76us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832086.550044:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788832086.550078:0:10466:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36de83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832086.550093:0:10466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:10466:1875726218364544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832086.550112:0:10466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832086.550117:0:10466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832086.550119:0:10466:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788832086.550122:0:10466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788832086.550180:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788832086.550199:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788832086.550210:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283537081 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537088 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832086.550220:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283537081 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537088 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832087.059165:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832087.059256:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202575488 00000100:00100000:0.0:1788832087.059265:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202575488 00000100:00100000:0.0:1788832087.059326:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 269 00000100:00100000:0.0:1788832087.059335:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+9:6168:x1875726202575488:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832087.059352:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832087.059371:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c36db8400/0x998c12b28353708f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04568 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832087.059398:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c36db8400/0x998c12b28353708f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04568 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832087.059409:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c36db8400/0x998c12b28353708f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04568 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832087.059419:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c36db8400, rc 0) 00000100:00100000:0.0:1788832087.059475:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+10:6168:x1875726202575488:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 140us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832087.059495:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 269 00000100:00100000:3.0:1788832087.065911:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832087.065989:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202575616 00000100:00100000:0.0:1788832087.066000:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202575616 00000100:00100000:0.0:1788832087.066061:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 270 00000100:00100000:0.0:1788832087.066071:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+10:6168:x1875726202575616:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832087.066229:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+10:6168:x1875726202575616:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 159us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832087.066236:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 270 00000100:00100000:3.0:1788832087.074204:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832087.074346:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202575744 00000100:00100000:0.0:1788832087.074356:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202575744 00000100:00100000:0.0:1788832087.074458:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 271 00000100:00100000:0.0:1788832087.074470:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+10:6168:x1875726202575744:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832087.074644:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+10:6168:x1875726202575744:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 153us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832087.074652:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 271 00000100:00100000:1.0:1788832087.083842:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832087.086414:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202575872 00000100:00100000:3.0:1788832087.086427:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202575872 00000100:00100000:3.0:1788832087.086565:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 272 00000100:00100000:3.0:1788832087.086577:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+10:6722:x1875726202575872:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788832087.086747:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+10:6722:x1875726202575872:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 171us (2913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832087.086755:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 272 00000100:00100000:3.0:1788832087.091227:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832087.091290:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202576000 00000100:00100000:1.0:1788832087.091300:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202576000 00000100:00100000:1.0:1788832087.091356:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 273 00000100:00100000:1.0:1788832087.091365:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+10:6722:x1875726202576000:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788832087.091512:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+10:6722:x1875726202576000:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 147us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832087.091541:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 273 00010000:00010000:2.0:1788832087.512556:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832087.764676:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832087.764719:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832087.764721:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202576256 00000100:00100000:1.0:1788832087.764732:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202576256 00000100:00100000:3.0:1788832087.764757:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832087.764787:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832087.764802:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202576128 00000100:00100000:1.0:1788832087.764807:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202576128 00000100:00080000:3.0:1788832087.764809:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788832087.764817:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832087.764840:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:1.0:1788832087.764852:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202576256:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832087.764875:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202576512 00000100:00100000:2.0:1788832087.764880:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202576512 00000100:00100000:2.0:1788832087.764919:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202576384 00000100:00100000:2.0:1788832087.764922:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202576384 00000100:00100000:1.0:1788832087.764928:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202576256:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 79us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832087.764938:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:1.0:1788832087.764958:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:1.0:1788832087.764967:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202576128:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832087.764973:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:2.0:1788832087.764984:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202576512:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832087.764998:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202576128:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 32us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832087.765005:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:2.0:1788832087.765022:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202576512:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 41us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832087.765029:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:2.0:1788832087.765045:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:2.0:1788832087.765053:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202576384:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832087.765092:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202576384:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 40us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832087.765098:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00080000:3.0:1788832087.765879:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788832087.765885:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788832088.534863:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832088.791053:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832088.791084:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218364672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832088.791445:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832088.791544:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218364672 00000100:00100000:3.0:1788832088.791551:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218364672 00000100:00100000:3.0:1788832088.791610:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788832088.791641:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218364672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788832088.791676:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788832088.791726:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218364672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832088.791733:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788832088.792699:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218364672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788832089.303737:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218364800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788832089.304301:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832089.304380:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218364800 00000100:00100000:0.0:1788832089.304387:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218364800 00000100:00100000:0.0:1788832089.304442:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788832089.304460:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218364800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788832089.304499:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788832089.304557:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218364800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832089.304573:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788832089.304616:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218364800:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788832089.562496:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832089.814962:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b074f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218364928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832089.815860:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832089.815919:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218365440:0@lo:400:kworker.0 00000100:00100000:3.0:1788832089.815951:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832089.815973:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218365952:0@lo:400:kworker.0 00000100:00100000:3.0:1788832089.815994:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832089.816011:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788832089.816017:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875726218365312:0@lo:400:kworker.0 00000100:00100000:1.0:1788832089.816097:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218365056:0@lo:400:kworker.0 00000100:00100000:3.0:1788832089.816120:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832089.816132:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832089.816139:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218365824:0@lo:400:kworker.0 00000100:00100000:1.0:1788832089.816154:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218365568:0@lo:400:kworker.0 00000100:00100000:3.0:1788832089.816164:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832089.816178:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832089.816180:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218366336:0@lo:400:kworker.0 00000100:00100000:1.0:1788832089.816193:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1875726218366080:0@lo:400:kworker.0 00000100:00100000:3.0:1788832089.816203:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832089.816233:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218365440 00000100:00100000:3.0:1788832089.816301:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218365440 00000100:00100000:3.0:1788832089.816357:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788832089.816442:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218365440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832089.816590:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218365952 00000100:00100000:3.0:1788832089.816596:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218365440:12345-0@lo:400:kworker.0 Request processed in 157us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832089.816596:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218365952 00000100:00100000:3.0:1788832089.816607:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788832089.816661:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218365824 00000100:00100000:3.0:1788832089.816665:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218365824 00000100:00100000:2.0:1788832089.816673:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218366336 00000100:00100000:2.0:1788832089.816679:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218366336 00000100:00100000:3.0:1788832089.816701:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788832089.816709:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788832089.816714:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218365952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832089.816723:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218365824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832089.816755:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218365952:12345-0@lo:400:kworker.0 Request processed in 45us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832089.816775:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218365824:12345-0@lo:400:kworker.0 Request processed in 56us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832089.816782:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788832089.816795:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788832089.816801:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218366336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832089.816831:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218366336:12345-0@lo:400:kworker.0 Request processed in 30us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832089.816844:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788832089.816869:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788832089.816874:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788832089.816905:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcb8a80 x1875726218365824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832089.816919:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218365824:0@lo:400:kworker.0 00010000:00080000:3.0:1788832089.816929:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0771d500 x1875726218366336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832089.816936:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218366336:0@lo:400:kworker.0 00010000:00080000:3.0:1788832089.816945:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcbbb80 x1875726218365952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832089.816953:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218365952:0@lo:400:kworker.0 00000100:00100000:3.0:1788832089.816965:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218365440:0@lo:400:kworker.0 00000100:00100000:1.0:1788832089.817150:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832089.817178:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788832089.817186:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218365184:0@lo:400:kworker.0 00000100:00100000:1.0:1788832089.817214:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832089.817351:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218365312 00000100:00100000:3.0:1788832089.817356:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218365312 00000100:00100000:3.0:1788832089.817453:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218365568 00000100:00100000:3.0:1788832089.817533:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218365568 00000100:00100000:3.0:1788832089.817557:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218366080 00000100:00100000:3.0:1788832089.817560:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218366080 00000100:00100000:3.0:1788832089.817571:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218365184 00000100:00100000:3.0:1788832089.817573:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218365184 00000100:00100000:3.0:1788832089.817586:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788832089.817592:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875726218365312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832089.817656:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875726218365312:12345-0@lo:400:kworker.0 Request processed in 63us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832089.817664:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788832089.817680:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788832089.817687:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218365568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832089.817725:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218365568:12345-0@lo:400:kworker.0 Request processed in 38us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832089.817732:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788832089.817746:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788832089.817752:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875726218366080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832089.817848:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218365696:0@lo:400:kworker.0 00000100:00100000:1.0:1788832089.817880:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832089.817894:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218366208:0@lo:400:kworker.0 00000100:00100000:1.0:1788832089.817916:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832089.817940:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218365568:0@lo:400:kworker.0 00000100:00100000:1.0:1788832089.817971:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218364928 00000100:00100000:1.0:1788832089.817974:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218364928 00000100:00100000:1.0:1788832089.818008:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788832089.818015:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218364928:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832089.818130:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875726218366080:12345-0@lo:400:kworker.0 Request processed in 378us (1908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832089.818136:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788832089.818148:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218365696 00000100:00100000:3.0:1788832089.818151:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218365696 00000100:00100000:3.0:1788832089.818165:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218366208 00000100:00100000:3.0:1788832089.818168:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218366208 00000100:00100000:3.0:1788832089.818180:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788832089.818185:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218365184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832089.818212:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218365184:12345-0@lo:400:kworker.0 Request processed in 27us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832089.818224:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788832089.818237:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00002000:00000024:1.0:1788832089.818332:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832089.818454:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218364928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 440us (2596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832089.818536:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788832089.818570:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218365056 00000100:00100000:1.0:1788832089.818574:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218365056 00000100:00100000:1.0:1788832089.818745:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788832089.818754:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218365056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832089.818854:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218365696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832089.818901:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218365696:12345-0@lo:400:kworker.0 Request processed in 657us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832089.818908:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788832089.818927:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788832089.818936:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875726218366208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832089.818975:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875726218366208:12345-0@lo:400:kworker.0 Request processed in 40us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832089.818982:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1788832089.819003:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788832089.819009:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788832089.819012:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832089.819066:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788832089.819140:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875726218365312:0@lo:400:kworker.0 00010000:00080000:2.0:1788832089.819158:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b074f4000 x1875726218364928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832089.819175:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b074f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218364928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832089.820730:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218365056:12345-0@lo:400:kworker.0 Request processed in 1970us (4589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832089.820746:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788832089.820862:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218365184:0@lo:400:kworker.0 00010000:00080000:3.0:1788832089.820880:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b06611c00 x1875726218365696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832089.820888:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218365696:0@lo:400:kworker.0 00010000:00080000:3.0:1788832089.820897:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0771c000 x1875726218366208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832089.820902:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218366208:0@lo:400:kworker.0 00000100:00100000:3.0:1788832089.820908:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218365056:0@lo:400:kworker.0 00000100:00100000:3.0:1788832089.820914:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1875726218366080:0@lo:400:kworker.0 00000100:00100000:0.0:1788832090.329529:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788832090.329554:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218366464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788832090.329774:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832090.329919:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218366464 00000100:00100000:0.0:1788832090.329928:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218366464 00000100:00100000:0.0:1788832090.329979:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788832090.329989:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218366464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788832090.330011:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832090.330062:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218366464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832090.330071:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788832090.330122:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0756c380 x1875726218366464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832090.330146:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218366464:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788832090.584521:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832090.839793:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788832090.839820:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218366592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788832090.839898:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832090.840029:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218366592 00000100:00100000:1.0:1788832090.840039:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218366592 00000100:00100000:1.0:1788832090.840094:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788832090.840103:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218366592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788832090.840129:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832090.840172:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218366592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832090.840186:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788832090.840325:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0771ce00 x1875726218366592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832090.840341:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218366592:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1788832091.229073:0:10700:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1788832091.353331:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832091.353381:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218366720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832091.353448:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832091.353535:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218366720 00000100:00100000:2.0:1788832091.353544:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218366720 00000100:00100000:2.0:1788832091.353593:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788832091.353603:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218366720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788832091.353644:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788832091.353654:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832091.353691:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218366720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832091.353698:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788832091.353710:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07654a80 x1875726218366720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832107 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832091.353728:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218366720:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788832091.607430:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832092.631140:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832092.896432:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832092.896548:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832092.896581:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202576768 00000100:00100000:3.0:1788832092.896590:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202576768 00000100:00100000:0.0:1788832092.896984:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202576640 00000100:00100000:0.0:1788832092.896989:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202576640 00000100:00100000:0.0:1788832092.897034:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 275 00000100:00100000:0.0:1788832092.897043:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+10:2396:x1875726202576640:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832092.899942:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+10:2396:x1875726202576640:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 2886us (3506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832092.899958:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 275 00000100:00080000:0.0:1788832092.900032:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832092.901033:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 73 00000100:00100000:3.0:1788832092.901046:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+6:2396:x1875726202576768:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832092.901128:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+6:2396:x1875726202576768:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 85us (4588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832092.901135:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 73 00000100:00100000:3.0:1788832092.903353:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832092.903836:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202577024 00000100:00100000:0.0:1788832092.903850:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202577024 00000100:00100000:0.0:1788832092.903948:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:0.0:1788832092.903961:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202577024:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832092.904081:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202577024:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 123us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832092.904090:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00080000:2.0:1788832092.904795:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832092.908248:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832092.908430:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832092.908731:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202577152 00000100:00100000:3.0:1788832092.908749:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202577152 00000100:00100000:3.0:1788832092.908860:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:3.0:1788832092.908873:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202577152:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832092.908977:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202577152:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 107us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832092.908986:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00080000:0.0:1788832092.909183:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788832092.909408:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202576896 00000100:00100000:2.0:1788832092.909419:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202576896 00000100:00100000:2.0:1788832092.909503:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 74 00000100:00100000:2.0:1788832092.909519:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202576896:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832092.909593:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202576896:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 81us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832092.909601:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 74 00000100:00080000:0.0:1788832092.911447:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788832093.656729:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832093.917613:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788832093.917670:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218366848:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832093.917739:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832093.917803:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218366848 00000100:00100000:1.0:1788832093.917812:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218366848 00000100:00100000:1.0:1788832093.917928:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788832093.917939:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218366848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788832093.917972:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788832093.918028:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218366848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832093.918036:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788832093.918078:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218366848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788832094.422969:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218366976:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788832094.423057:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832094.424356:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218366976 00000100:00100000:3.0:1788832094.424371:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218366976 00000100:00100000:3.0:1788832094.424663:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788832094.424675:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218366976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788832094.424714:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788832094.424798:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218366976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832094.424817:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788832094.424908:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218366976:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788832094.679121:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832094.935080:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218367104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832094.935160:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832094.936591:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218367104 00000100:00100000:2.0:1788832094.936604:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218367104 00000100:00100000:2.0:1788832094.936702:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788832094.936713:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218367104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788832094.936743:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788832094.936816:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218367104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832094.936824:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788832094.936845:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788832094.936882:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0756f480 x1875726218367104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832094.936903:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218367104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832094.938821:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218367360:0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.938889:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832094.938927:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218367872:0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.938949:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832094.938970:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b074f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218368384:0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.938991:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832094.939011:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788832094.939017:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218367488:0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.939051:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832094.939071:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218368000:0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.939104:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832094.939122:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218368512:0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.939149:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832094.939186:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218367360 00000100:00100000:2.0:1788832094.939194:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218367360 00000100:00100000:2.0:1788832094.939227:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218367872 00000100:00100000:2.0:1788832094.939230:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218367872 00000100:00100000:2.0:1788832094.939536:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218368384 00000100:00100000:2.0:1788832094.939540:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218368384 00000100:00100000:2.0:1788832094.939552:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218367488 00000100:00100000:2.0:1788832094.939555:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218367488 00000100:00100000:2.0:1788832094.941859:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788832094.941875:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218367360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.941975:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218367360:12345-0@lo:400:kworker.0 Request processed in 105us (3085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832094.941982:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788832094.942005:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788832094.942012:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218367872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832094.942350:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218367360:0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.942439:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218367872:12345-0@lo:400:kworker.0 Request processed in 428us (3489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832094.942445:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788832094.942459:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788832094.942476:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218368384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.942505:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218368384:12345-0@lo:400:kworker.0 Request processed in 40us (3513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832094.942510:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788832094.942521:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788832094.942535:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218367488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.942562:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218367488:12345-0@lo:400:kworker.0 Request processed in 29us (3511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832094.943112:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788832094.943152:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218368000 00000100:00100000:2.0:1788832094.943160:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218368000 00000100:00100000:2.0:1788832094.943199:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218368512 00000100:00100000:2.0:1788832094.943202:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218368512 00000100:00100000:2.0:1788832094.943223:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788832094.943230:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218368000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832094.943357:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218367488:0@lo:400:kworker.0 00010000:00080000:0.0:1788832094.943372:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07654a80 x1875726218367872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832094.943383:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218367872:0@lo:400:kworker.0 00010000:00080000:0.0:1788832094.943394:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b074f4000 x1875726218368384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832094.943402:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b074f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218368384:0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.943975:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218368000:12345-0@lo:400:kworker.0 Request processed in 744us (4868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832094.943983:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788832094.944002:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788832094.944010:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218368512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.944053:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218368512:12345-0@lo:400:kworker.0 Request processed in 44us (4903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832094.944059:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788832094.944096:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218367232:0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.944151:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832094.944185:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1875726218367744:0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.944209:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832094.944229:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1875726218368256:0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.944264:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832094.944285:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788832094.944291:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218367616:0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.944325:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832094.944344:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218368128:0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.944365:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832094.944391:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218367232 00000100:00100000:2.0:1788832094.944395:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218367232 00000100:00100000:2.0:1788832094.944425:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788832094.944432:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:3652:x1875726218367232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.944478:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:3652:x1875726218367232:12345-0@lo:400:kworker.0 Request processed in 36us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832094.944484:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788832094.944510:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218367616 00000100:00100000:2.0:1788832094.944513:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218367616 00000100:00100000:2.0:1788832094.944536:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788832094.944542:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218367616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.944585:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218367616:12345-0@lo:400:kworker.0 Request processed in 43us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832094.944591:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788832094.944608:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218368128 00000100:00100000:2.0:1788832094.944611:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218368128 00000100:00100000:2.0:1788832094.944655:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788832094.944663:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218368128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.944695:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218368128:12345-0@lo:400:kworker.0 Request processed in 33us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832094.944700:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788832094.944723:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218367744 00000100:00100000:2.0:1788832094.944726:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218367744 00000100:00100000:2.0:1788832094.944747:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218368256 00000100:00100000:2.0:1788832094.944756:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218368256 00000100:00100000:2.0:1788832094.944780:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788832094.944785:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875726218367744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.944816:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875726218367744:12345-0@lo:400:kworker.0 Request processed in 31us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832094.944822:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788832094.944832:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788832094.944838:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875726218368256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.944862:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875726218368256:12345-0@lo:400:kworker.0 Request processed in 24us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832094.944868:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1788832094.944889:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788832094.944894:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788832094.944897:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788832094.944898:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788832094.944931:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218367616:0@lo:400:kworker.0 00010000:00080000:2.0:1788832094.944944:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07655f80 x1875726218368128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832094.944953:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218368128:0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.944961:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218367232:0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.944969:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1875726218367744:0@lo:400:kworker.0 00000100:00100000:2.0:1788832094.944978:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1875726218368256:0@lo:400:kworker.0 00010000:00080000:0.0:1788832094.951397:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07656a00 x1875726218368000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832094.951416:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218368000:0@lo:400:kworker.0 00010000:00080000:0.0:1788832094.951431:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcb6300 x1875726218368512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832094.951439:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218368512:0@lo:400:kworker.0 00000100:00100000:2.0:1788832095.447100:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832095.447124:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218368640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788832095.447212:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832095.447377:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218368640 00000100:00100000:3.0:1788832095.447386:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218368640 00000100:00100000:3.0:1788832095.447440:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788832095.447451:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218368640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788832095.447484:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832095.447538:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218368640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832095.447544:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788832095.447675:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c1fe25180 x1875726218368640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832095.447694:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218368640:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788832095.706067:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788832095.777448:0:10944:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing yml_node 00000100:00100000:1.0:1788832095.959985:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218368768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788832095.960100:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832095.960880:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218368768 00000100:00100000:3.0:1788832095.960890:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218368768 00000100:00100000:3.0:1788832095.960947:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788832095.960957:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218368768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788832095.960988:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832095.961050:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218368768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832095.961058:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788832095.962598:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0771d180 x1875726218368768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832095.962638:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218368768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832096.474892:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218368896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832096.474976:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832096.475055:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218368896 00000100:00100000:2.0:1788832096.475064:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218368896 00000100:00100000:2.0:1788832096.475119:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788832096.475128:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218368896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788832096.475152:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788832096.475196:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218368896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832096.475203:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788832096.475222:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788832096.475715:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b077b9500 x1875726218368896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832112 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832096.475734:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218368896:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788832096.726966:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832097.757343:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832098.013295:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832098.013351:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832098.013383:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832098.013427:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832098.013454:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202577536 00000100:00100000:2.0:1788832098.013470:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202577536 00000100:00100000:2.0:1788832098.013551:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202577408 00000100:00100000:2.0:1788832098.013555:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202577408 00000100:00100000:2.0:1788832098.013587:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 81 00000100:00100000:2.0:1788832098.013598:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202577536:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832098.013678:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832098.013705:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202577664 00000100:00100000:1.0:1788832098.013709:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202577664 00000100:00100000:2.0:1788832098.013737:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202577536:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 140us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832098.013746:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 81 00000100:00100000:1.0:1788832098.013757:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202577792 00000100:00100000:1.0:1788832098.013761:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202577792 00000100:00100000:2.0:1788832098.013771:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 82 00000100:00100000:2.0:1788832098.013782:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+6:2395:x1875726202577408:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832098.013793:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:1.0:1788832098.013806:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+5:2392:x1875726202577664:12345-192.168.203.26@tcp:9:kworker.0 00000100:00100000:2.0:1788832098.013813:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+6:2395:x1875726202577408:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 31us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832098.013821:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 82 00000020:00000080:1.0:1788832098.013838:0:10097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536fa1 00000100:00080000:2.0:1788832098.013841:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788832098.013848:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788832098.013850:0:10097:0:(import.c:65:import_set_state_nolock()) ffff9d2c3fd3f000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1788832098.013852:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788832098.013856:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788832098.013879:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:2.0:1788832098.013887:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2392:x1875726202577792:12345-192.168.203.26@tcp:9:kworker.0 00000001:00000004:1.0:1788832098.013895:0:10097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000020:00000080:2.0:1788832098.013907:0:8440:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536fa8 00000100:00080000:2.0:1788832098.013914:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9d2c3fd39000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788832098.013945:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788832098.014027:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+2:2392:x1875726202577664:12345-192.168.203.26@tcp:9:kworker.0 Request processed in 225us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832098.014035:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00010000:00010000:1.0:1788832098.014132:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832098.014257:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202577280 00000100:00100000:0.0:1788832098.014262:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202577280 00000100:00100000:0.0:1788832098.014298:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 277 00000100:00100000:0.0:1788832098.014306:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+10:2395:x1875726202577280:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832098.014353:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+10:2395:x1875726202577280:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 47us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832098.014368:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 277 00010000:00010000:0.0:1788832098.014396:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832098.014790:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+2:2392:x1875726202577792:12345-192.168.203.26@tcp:9:kworker.0 Request processed in 902us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832098.014797:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00010000:00010000:1.0:1788832098.774812:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832099.031416:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788832099.031457:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218369024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788832099.031552:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832099.032132:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218369024 00000100:00100000:0.0:1788832099.032144:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218369024 00000100:00100000:0.0:1788832099.032222:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788832099.032234:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218369024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788832099.032279:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788832099.032353:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218369024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832099.032361:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788832099.034673:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218369024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788832099.542865:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788832099.554732:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218369152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788832099.554849:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832099.555533:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218369152 00000100:00100000:2.0:1788832099.555550:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218369152 00000100:00100000:2.0:1788832099.555675:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788832099.555685:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218369152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788832099.555723:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788832099.555828:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218369152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832099.555834:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788832099.557786:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218369152:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788832099.799000:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832100.057548:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218369280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832100.057744:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832100.058367:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b073bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218369792:0@lo:400:kworker.0 00000100:00100000:1.0:1788832100.058400:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832100.058421:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b073bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218370304:0@lo:400:kworker.0 00000100:00100000:1.0:1788832100.058456:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832100.058473:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b073be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218370816:0@lo:400:kworker.0 00000100:00100000:1.0:1788832100.058494:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832100.058667:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788832100.058675:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218369664:0@lo:400:kworker.0 00000100:00100000:1.0:1788832100.058712:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832100.058733:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b073bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1875726218370176:0@lo:400:kworker.0 00000100:00100000:1.0:1788832100.061125:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832100.061164:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b073bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218370688:0@lo:400:kworker.0 00000100:00100000:1.0:1788832100.061188:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832100.061230:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218370304 00000100:00100000:1.0:1788832100.061238:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218370304 00000100:00100000:3.0:1788832100.061362:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218369408:0@lo:400:kworker.0 00000100:00100000:3.0:1788832100.061397:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832100.061439:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b073be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218369920:0@lo:400:kworker.0 00000100:00100000:3.0:1788832100.061480:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832100.061513:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b073bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218370432:0@lo:400:kworker.0 00000100:00100000:3.0:1788832100.061540:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832100.061570:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788832100.061577:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218369536:0@lo:400:kworker.0 00000100:00100000:3.0:1788832100.061599:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832100.061615:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b073bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218370048:0@lo:400:kworker.0 00000100:00100000:3.0:1788832100.061970:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832100.061983:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b073bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218370560:0@lo:400:kworker.0 00000100:00100000:3.0:1788832100.062002:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832100.062030:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218369408 00000100:00100000:3.0:1788832100.062034:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218369408 00000100:00100000:3.0:1788832100.062070:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788832100.062079:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3653:x1875726218369408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832100.062128:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3653:x1875726218369408:12345-0@lo:400:kworker.0 Request processed in 50us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832100.062136:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788832100.062168:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218369664 00000100:00100000:3.0:1788832100.062172:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218369664 00000100:00100000:3.0:1788832100.062193:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218369920 00000100:00100000:3.0:1788832100.062196:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218369920 00000100:00100000:3.0:1788832100.062209:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788832100.062216:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218369664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832100.062258:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218369664:12345-0@lo:400:kworker.0 Request processed in 43us (3546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832100.062264:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788832100.062284:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788832100.062289:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218369920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832100.062320:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218369920:12345-0@lo:400:kworker.0 Request processed in 31us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832100.062326:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788832100.062343:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218370816 00000100:00100000:3.0:1788832100.062347:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218370816 00000100:00100000:3.0:1788832100.062370:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218370432 00000100:00100000:3.0:1788832100.062372:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218370432 00000100:00100000:3.0:1788832100.062387:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788832100.062393:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218370304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832100.062424:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218370304:12345-0@lo:400:kworker.0 Request processed in 31us (3967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832100.063338:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218369280 00000100:00100000:2.0:1788832100.063345:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218369280 00000100:00100000:2.0:1788832100.063384:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788832100.063485:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218369280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788832100.063510:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788832100.063651:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218369280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 259us (5917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832100.063658:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788832100.063685:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218369792 00000100:00100000:2.0:1788832100.063689:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218369792 00000100:00100000:2.0:1788832100.063706:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218370176 00000100:00100000:2.0:1788832100.063708:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218370176 00000100:00100000:2.0:1788832100.063720:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218370688 00000100:00100000:2.0:1788832100.063723:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218370688 00000100:00100000:2.0:1788832100.063732:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218369536 00000100:00100000:2.0:1788832100.063735:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218369536 00000100:00100000:2.0:1788832100.063744:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218370048 00000100:00100000:2.0:1788832100.063746:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218370048 00000100:00100000:2.0:1788832100.063755:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218370560 00000100:00100000:2.0:1788832100.063758:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218370560 00000100:00100000:2.0:1788832100.063769:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788832100.063775:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218369792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832100.063809:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218369792:12345-0@lo:400:kworker.0 Request processed in 33us (5407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832100.063815:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788832100.063827:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788832100.063833:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875726218370176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832100.063873:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875726218370176:12345-0@lo:400:kworker.0 Request processed in 41us (2755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832100.063878:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788832100.063890:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788832100.063896:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875726218370688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832100.063924:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875726218370688:12345-0@lo:400:kworker.0 Request processed in 28us (2735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832100.063930:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788832100.063941:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788832100.063947:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218369536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832100.063990:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218369536:12345-0@lo:400:kworker.0 Request processed in 43us (2390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832100.063996:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788832100.064008:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788832100.064014:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218370048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832100.064039:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218370048:12345-0@lo:400:kworker.0 Request processed in 26us (2070us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832100.064045:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788832100.064055:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788832100.064060:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218370560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832100.064086:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218370560:12345-0@lo:400:kworker.0 Request processed in 26us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832100.064092:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788832100.066200:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788832100.066643:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788832100.066663:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218370816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832100.066754:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218370816:12345-0@lo:400:kworker.0 Request processed in 101us (8258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832100.066762:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788832100.066782:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788832100.066790:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218370432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832100.066823:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218370432:12345-0@lo:400:kworker.0 Request processed in 35us (5282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832100.066829:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788832100.067914:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788832100.067922:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788832100.067925:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788832100.067928:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832100.070816:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218369664:0@lo:400:kworker.0 00010000:00080000:1.0:1788832100.070836:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b073bd180 x1875726218370176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832100.070847:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b073bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1875726218370176:0@lo:400:kworker.0 00010000:00080000:1.0:1788832100.070858:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b073bed80 x1875726218370688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832100.070867:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b073bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218370688:0@lo:400:kworker.0 00000100:00100000:1.0:1788832100.070877:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b073bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218369792:0@lo:400:kworker.0 00010000:00080000:1.0:1788832100.070887:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b073bd880 x1875726218370304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832100.070894:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b073bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218370304:0@lo:400:kworker.0 00010000:00080000:1.0:1788832100.070905:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b073be680 x1875726218370816/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832100.070912:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b073be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218370816:0@lo:400:kworker.0 00010000:00080000:1.0:1788832100.070923:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0771c700 x1875726218369280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832100.070953:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218369280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832100.071680:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218369536:0@lo:400:kworker.0 00000100:00100000:3.0:1788832100.071693:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b073bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218370048:0@lo:400:kworker.0 00000100:00100000:3.0:1788832100.071704:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b073bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218370560:0@lo:400:kworker.0 00000100:00100000:3.0:1788832100.071713:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218369408:0@lo:400:kworker.0 00000100:00100000:3.0:1788832100.071724:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b073be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218369920:0@lo:400:kworker.0 00010000:00080000:3.0:1788832100.071736:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b073bf480 x1875726218370432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832100.071746:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b073bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218370432:0@lo:400:kworker.0 00000100:00100000:2.0:1788832100.573836:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218370944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788832100.573915:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832100.574289:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218370944 00000100:00100000:0.0:1788832100.574299:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218370944 00000100:00100000:0.0:1788832100.574367:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788832100.574378:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218370944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788832100.574401:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832100.574604:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218370944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 226us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832100.574612:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788832100.574819:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f3480 x1875726218370944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832100.574838:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218370944:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1788832100.582423:0:11127:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.110 00010000:00010000:1.0:1788832100.822725:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832101.081435:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832101.081459:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218371072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832101.081523:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832101.081553:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218371072 00000100:00100000:0.0:1788832101.081561:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218371072 00000100:00100000:0.0:1788832101.081603:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788832101.081613:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218371072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788832101.081675:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832101.081721:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218371072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832101.081728:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788832101.081746:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b077bb100 x1875726218371072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832117 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832101.081764:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218371072:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788832101.591035:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788832101.591056:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218371200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788832101.591121:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832101.591413:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218371200 00000100:00100000:3.0:1788832101.591427:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218371200 00000100:00100000:3.0:1788832101.591497:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788832101.591506:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218371200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788832101.591527:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832101.591583:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218371200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832101.591590:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788832101.591650:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b077bb100 x1875726218371200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832117 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832101.591670:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218371200:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788832101.846922:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788832102.770256:0:11225:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.110 00010000:00010000:1.0:1788832102.874590:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832103.123561:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832103.123715:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832103.123743:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832103.123798:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202577920 00000100:00100000:0.0:1788832103.123808:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202577920 00000100:00100000:0.0:1788832103.123861:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 279 00000100:00100000:0.0:1788832103.123871:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+10:2393:x1875726202577920:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832103.123948:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+10:2393:x1875726202577920:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 72us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832103.123956:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 279 00000100:00100000:2.0:1788832103.129122:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202578048 00000100:00100000:2.0:1788832103.129205:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202578048 00000100:00100000:2.0:1788832103.129269:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202578176 00000100:00100000:2.0:1788832103.129272:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202578176 00000100:00100000:2.0:1788832103.129307:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 89 00000100:00100000:2.0:1788832103.129318:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202578048:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832103.129403:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202578048:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 87us (5850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832103.129420:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 89 00000100:00100000:2.0:1788832103.129440:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 90 00000100:00100000:2.0:1788832103.129447:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202578176:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832103.129486:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202578176:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 40us (5742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832103.129494:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 90 00000100:00080000:2.0:1788832103.129514:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788832103.129518:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788832103.895122:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832104.150933:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218371328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832104.151003:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832104.151194:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218371328 00000100:00100000:3.0:1788832104.151202:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218371328 00000100:00100000:3.0:1788832104.151264:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788832104.151273:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218371328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788832104.151305:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788832104.151350:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218371328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832104.151358:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788832104.151514:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218371328:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1788832104.157467:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 352fff76-09db-42cd-818a-16e788a01abb 00000020:00000080:1.0:1788832104.157476:0:9518:0:(genops.c:885:class_export_put()) final put ffff9d2c3fd3c800/352fff76-09db-42cd-818a-16e788a01abb 00000020:00000080:3.0:1788832104.157853:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3fd3c800/352fff76-09db-42cd-818a-16e788a01abb for lustre-OST0001 00000020:00000080:3.0:1788832104.157913:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c3fd39000 for lustre-OST0001 00000001:00100000:2.0:1788832104.158332:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 352fff76-09db-42cd-818a-16e788a01abb 00000020:00000080:2.0:1788832104.158338:0:8434:0:(genops.c:885:class_export_put()) final put ffff9d2c3fd3d000/352fff76-09db-42cd-818a-16e788a01abb 00000020:00000080:0.0:1788832104.159078:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3fd3d000/352fff76-09db-42cd-818a-16e788a01abb for lustre-OST0000 00000020:00000080:0.0:1788832104.159122:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c3fd3f000 for lustre-OST0000 00000100:00100000:3.0:1788832104.663742:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218371456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788832104.663816:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832104.663889:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218371456 00000100:00100000:3.0:1788832104.663896:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218371456 00000100:00100000:3.0:1788832104.663942:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788832104.663951:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218371456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788832104.663999:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788832104.664046:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218371456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832104.664054:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788832104.664098:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218371456:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788832104.919966:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788832104.923067:0:11322:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.110 00000100:00100000:2.0:1788832105.175106:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832105.175133:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b073bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218371584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832105.175203:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832105.175504:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218371712:0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.175558:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832105.175590:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218372224:0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.175614:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832105.175654:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218372736:0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.175677:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832105.175696:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788832105.175701:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218371840:0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.175726:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832105.175742:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218372352:0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.175760:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832105.175775:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1875726218372864:0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.175791:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832105.175816:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218372224 00000100:00100000:0.0:1788832105.175824:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218372224 00000100:00100000:0.0:1788832105.175869:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788832105.175878:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218372224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.175932:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218372224:12345-0@lo:400:kworker.0 Request processed in 55us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832105.175939:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788832105.175961:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218372736 00000100:00100000:0.0:1788832105.175964:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218372736 00000100:00100000:0.0:1788832105.175995:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788832105.176002:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218372736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.176032:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218372736:12345-0@lo:400:kworker.0 Request processed in 31us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832105.176038:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788832105.176064:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218371840 00000100:00100000:0.0:1788832105.176067:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218371840 00000100:00100000:0.0:1788832105.176089:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218372352 00000100:00100000:0.0:1788832105.176091:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218372352 00000100:00100000:0.0:1788832105.176102:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218372864 00000100:00100000:0.0:1788832105.176103:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218372864 00000100:00100000:0.0:1788832105.176115:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788832105.176121:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218371840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.176152:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218371840:12345-0@lo:400:kworker.0 Request processed in 32us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832105.176157:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788832105.176167:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788832105.176172:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218372352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.176195:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218372352:12345-0@lo:400:kworker.0 Request processed in 23us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832105.176201:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788832105.176210:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788832105.176216:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875726218372864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.176241:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875726218372864:12345-0@lo:400:kworker.0 Request processed in 26us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832105.176246:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788832105.176276:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875726218372096:0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.176299:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832105.176314:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218372608:0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.176333:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832105.176349:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218373120:0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.176382:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832105.176415:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788832105.176421:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218371968:0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.176442:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832105.176459:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218372480:0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.176478:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832105.176492:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218372992:0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.176510:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832105.176532:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218372608 00000100:00100000:0.0:1788832105.176536:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218372608 00000100:00100000:0.0:1788832105.176560:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218373120 00000100:00100000:0.0:1788832105.176563:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218373120 00000100:00100000:0.0:1788832105.176581:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788832105.176587:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218372608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.176647:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218372608:12345-0@lo:400:kworker.0 Request processed in 60us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832105.176653:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788832105.176665:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788832105.176671:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218373120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.176700:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218373120:12345-0@lo:400:kworker.0 Request processed in 29us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832105.176705:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788832105.176721:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218371968 00000100:00100000:0.0:1788832105.176724:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218371968 00000100:00100000:0.0:1788832105.176743:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788832105.176749:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218371968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.176785:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218371968:12345-0@lo:400:kworker.0 Request processed in 36us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832105.176791:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788832105.176811:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218372096 00000100:00100000:0.0:1788832105.176815:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218372096 00000100:00100000:0.0:1788832105.176838:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218372480 00000100:00100000:0.0:1788832105.176841:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218372480 00000100:00100000:0.0:1788832105.176852:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218372992 00000100:00100000:0.0:1788832105.176854:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218372992 00000100:00100000:0.0:1788832105.176865:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788832105.176870:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875726218372096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.176898:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875726218372096:12345-0@lo:400:kworker.0 Request processed in 27us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832105.176903:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788832105.176914:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788832105.176920:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218372480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.176943:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218372480:12345-0@lo:400:kworker.0 Request processed in 24us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832105.176948:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788832105.176959:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788832105.176964:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218372992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.176990:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218372992:12345-0@lo:400:kworker.0 Request processed in 26us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832105.176995:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788832105.177036:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218371968:0@lo:400:kworker.0 00010000:00080000:0.0:1788832105.177049:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcb9880 x1875726218372480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832105.177065:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218372480:0@lo:400:kworker.0 00010000:00080000:0.0:1788832105.177077:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc06d80 x1875726218372992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832105.177084:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218372992:0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.177093:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875726218372096:0@lo:400:kworker.0 00010000:00080000:0.0:1788832105.177102:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcbbb80 x1875726218372608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832105.177109:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218372608:0@lo:400:kworker.0 00010000:00080000:0.0:1788832105.177118:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc06680 x1875726218373120/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832105.177124:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218373120:0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.177160:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218371840:0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.177172:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218372352:0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.177182:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1875726218372864:0@lo:400:kworker.0 00000100:00100000:0.0:1788832105.177191:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218372224:0@lo:400:kworker.0 00010000:00080000:0.0:1788832105.177201:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcb8a80 x1875726218372736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832105.177209:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218372736:0@lo:400:kworker.0 00000100:00080000:2.0:1788832105.177323:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788832105.177329:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788832105.177331:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788832105.177333:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788832105.177418:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218371712 00000100:00100000:3.0:1788832105.177423:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218371712 00000100:00100000:3.0:1788832105.177460:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788832105.177467:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218371712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832105.177519:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218371712:12345-0@lo:400:kworker.0 Request processed in 53us (1962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832105.177526:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788832105.177615:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218371712:0@lo:400:kworker.0 00000100:00100000:1.0:1788832105.177933:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218371584 00000100:00100000:1.0:1788832105.177938:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218371584 00000100:00080000:2.0:1788832105.178028:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788832105.178723:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788832105.178738:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218371584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788832105.178771:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832105.178841:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218371584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (3637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832105.178847:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788832105.178930:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b073bd880 x1875726218371584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832105.178949:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b073bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218371584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832105.686968:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218373248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788832105.687045:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832105.687227:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218373248 00000100:00100000:3.0:1788832105.687235:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218373248 00000100:00100000:3.0:1788832105.687298:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788832105.687308:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218373248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788832105.687330:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832105.687404:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218373248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832105.687413:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788832105.687752:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc05c00 x1875726218373248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832105.687785:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218373248:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788832105.943034:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832106.198823:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832106.198855:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218373376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832106.198944:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832106.199219:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218373376 00000100:00100000:3.0:1788832106.199230:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218373376 00000100:00100000:3.0:1788832106.199289:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788832106.199300:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218373376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788832106.200750:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832106.200889:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218373376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1587us (1941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832106.200901:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788832106.205558:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b077b8e00 x1875726218373376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832106.205610:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218373376:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1788832106.493251:0:11370:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 7 21:48:25 EDT 2026 00000100:00100000:3.0:1788832106.714940:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218373504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788832106.715041:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832106.715166:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218373504 00000100:00100000:3.0:1788832106.715176:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218373504 00000100:00100000:3.0:1788832106.715355:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788832106.715367:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218373504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788832106.715405:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832106.715460:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218373504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832106.715468:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788832106.715522:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc06a00 x1875726218373504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832106.715543:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218373504:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788832106.970157:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832107.993579:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832108.243655:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832108.243709:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832108.243751:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832108.243798:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202578432 00000100:00100000:3.0:1788832108.243811:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202578432 00000100:00100000:2.0:1788832108.243816:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202578304 00000100:00100000:2.0:1788832108.243824:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202578304 00000100:00100000:3.0:1788832108.243885:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202578560 00000100:00100000:2.0:1788832108.243886:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 281 00000100:00100000:3.0:1788832108.243891:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202578560 00000100:00100000:2.0:1788832108.243900:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+10:2394:x1875726202578304:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832108.243925:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 97 00000100:00100000:3.0:1788832108.243937:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+6:2394:x1875726202578432:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832108.243986:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+10:2394:x1875726202578304:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 88us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832108.243995:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 281 00000100:00100000:3.0:1788832108.244115:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+6:2394:x1875726202578432:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 180us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832108.244131:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 97 00000100:00100000:3.0:1788832108.244149:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 98 00000100:00100000:3.0:1788832108.244156:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+5:2394:x1875726202578560:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832108.244200:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+5:2394:x1875726202578560:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 44us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832108.244207:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 98 00000100:00080000:3.0:1788832108.244227:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788832108.244231:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788832109.014947:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832109.270843:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832109.270876:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218373632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832109.270964:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832109.271050:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218373632 00000100:00100000:0.0:1788832109.271068:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218373632 00000100:00100000:0.0:1788832109.271139:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788832109.271151:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218373632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788832109.271204:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788832109.271270:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218373632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832109.271278:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788832109.271330:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218373632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832109.782868:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218373760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788832109.782973:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832109.783172:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218373760 00000100:00100000:3.0:1788832109.783183:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218373760 00000100:00100000:3.0:1788832109.783286:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788832109.783298:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218373760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788832109.783354:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788832109.783435:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218373760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832109.783443:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788832109.783527:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218373760:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788832110.040136:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832110.295026:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218374016:0@lo:400:kworker.0 00000100:00100000:0.0:1788832110.295123:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832110.295233:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218374016 00000100:00100000:0.0:1788832110.295244:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218374016 00000100:00100000:3.0:1788832110.295455:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832110.295468:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218373888:0@lo:400:kworker.0 00000100:00100000:3.0:1788832110.295516:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832110.295563:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218373888 00000100:00100000:2.0:1788832110.295568:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218374144:0@lo:400:kworker.0 00000100:00100000:3.0:1788832110.295569:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218373888 00000100:00100000:3.0:1788832110.295610:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788832110.295641:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218373888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832110.295652:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832110.295692:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218374144 00000100:00100000:2.0:1788832110.295697:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218374144 00000100:00100000:3.0:1788832110.295706:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218373888:12345-0@lo:400:kworker.0 Request processed in 85us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832110.295725:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788832110.295729:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788832110.295739:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218374144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832110.295789:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218373888:0@lo:400:kworker.0 00000100:00100000:3.0:1788832110.295839:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218374272:0@lo:400:kworker.0 00000100:00100000:3.0:1788832110.295865:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832110.295892:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218374272 00000100:00100000:3.0:1788832110.295895:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218374272 00000100:00100000:3.0:1788832110.295917:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788832110.295923:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218374016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832110.295954:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218374016:12345-0@lo:400:kworker.0 Request processed in 31us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832110.295974:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788832110.295988:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788832110.295994:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218374272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832110.296024:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218374272:12345-0@lo:400:kworker.0 Request processed in 30us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832110.296030:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788832110.296056:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218374272:0@lo:400:kworker.0 00000100:00100000:3.0:1788832110.296082:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832110.296089:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218374400:0@lo:400:kworker.0 00000100:00100000:3.0:1788832110.296111:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832110.296135:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218374144:12345-0@lo:400:kworker.0 Request processed in 395us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832110.296144:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788832110.296145:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218374400 00000100:00100000:3.0:1788832110.296150:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218374400 00000100:00100000:2.0:1788832110.296170:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788832110.296179:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218374400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832110.296218:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218374400:12345-0@lo:400:kworker.0 Request processed in 40us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832110.296356:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b073bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218374528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832110.296402:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832110.296436:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218374016:0@lo:400:kworker.0 00000100:00100000:1.0:1788832110.296458:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218374528 00000100:00100000:1.0:1788832110.296462:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218374528 00000100:00100000:1.0:1788832110.296504:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788832110.296521:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218374528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788832110.296548:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832110.296585:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218374528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832110.296591:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788832110.296608:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788832110.296660:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b073bca80 x1875726218374528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832110.296676:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b073bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218374528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832110.296712:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218374400:0@lo:400:kworker.0 00000100:00100000:1.0:1788832110.296740:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788832110.296746:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b073bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218374656:0@lo:400:kworker.0 00000100:00100000:1.0:1788832110.296772:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832110.296810:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b073bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218374784:0@lo:400:kworker.0 00000100:00100000:1.0:1788832110.296831:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832110.296853:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218374656 00000100:00100000:1.0:1788832110.296857:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218374656 00000100:00100000:1.0:1788832110.296883:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218374784 00000100:00100000:1.0:1788832110.296886:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218374784 00000100:00100000:1.0:1788832110.296901:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788832110.296908:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218374656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832110.296942:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218374656:12345-0@lo:400:kworker.0 Request processed in 35us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832110.296948:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788832110.298244:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788832110.298282:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218374784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832110.298424:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218374784:12345-0@lo:400:kworker.0 Request processed in 166us (1590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832110.300734:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788832110.301300:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788832110.301309:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832110.301399:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218374912:0@lo:400:kworker.0 00000100:00100000:2.0:1788832110.301492:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832110.301652:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832110.301660:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218375296:0@lo:400:kworker.0 00000100:00100000:2.0:1788832110.301691:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832110.301735:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218375424:0@lo:400:kworker.0 00000100:00100000:2.0:1788832110.301758:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832110.301810:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218375296 00000100:00100000:2.0:1788832110.301818:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218375296 00000100:00100000:3.0:1788832110.304334:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218374144:0@lo:400:kworker.0 00000100:00100000:3.0:1788832110.304408:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1875726218375168:0@lo:400:kworker.0 00000100:00100000:3.0:1788832110.304520:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832110.304558:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788832110.304565:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218375040:0@lo:400:kworker.0 00000100:00100000:3.0:1788832110.304592:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832110.304675:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218374912 00000100:00100000:3.0:1788832110.304786:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218374912 00000100:00100000:3.0:1788832110.304849:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218375424 00000100:00100000:3.0:1788832110.304853:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218375424 00000100:00100000:3.0:1788832110.304875:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218375040 00000100:00100000:3.0:1788832110.304877:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218375040 00000100:00100000:3.0:1788832110.304894:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788832110.304903:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218374912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832110.305561:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218374912:12345-0@lo:400:kworker.0 Request processed in 653us (4064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832110.305571:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788832110.305597:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788832110.305605:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218375424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832110.305670:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218375424:12345-0@lo:400:kworker.0 Request processed in 67us (3910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832110.305675:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788832110.305859:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788832110.305872:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218375040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832110.305935:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218375040:12345-0@lo:400:kworker.0 Request processed in 67us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832110.305942:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788832110.306138:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36c8a300 x1875726218375424/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832110.306156:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218375424:0@lo:400:kworker.0 00010000:00080000:3.0:1788832110.306172:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b077bb480 x1875726218374912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832110.306182:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218374912:0@lo:400:kworker.0 00010000:00080000:3.0:1788832110.306242:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f1180 x1875726218375040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832110.306252:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218375040:0@lo:400:kworker.0 00000100:00080000:3.0:1788832110.306298:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788832110.306304:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788832110.306308:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788832110.306465:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218375168 00000100:00100000:3.0:1788832110.306473:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218375168 00000100:00100000:3.0:1788832110.306518:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788832110.306525:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875726218375168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832110.306575:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875726218375168:12345-0@lo:400:kworker.0 Request processed in 51us (2055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832110.306582:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1788832110.306598:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832110.306647:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b073bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218374656:0@lo:400:kworker.0 00000100:00100000:3.0:1788832110.306681:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1875726218375168:0@lo:400:kworker.0 00010000:00080000:0.0:1788832110.306831:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b073bea00 x1875726218374784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832110.306842:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b073bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218374784:0@lo:400:kworker.0 00000100:00100000:1.0:1788832110.307763:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788832110.311720:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788832110.311755:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875726218375296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832110.313127:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875726218375296:12345-0@lo:400:kworker.0 Request processed in 1382us (11425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832110.313143:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:1.0:1788832110.320778:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36c88e00 x1875726218375296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832110.320814:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218375296:0@lo:400:kworker.0 00000100:00100000:1.0:1788832110.808852:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218375552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788832110.808961:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832110.809742:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218375552 00000100:00100000:3.0:1788832110.809756:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218375552 00000100:00100000:3.0:1788832110.809834:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788832110.809847:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218375552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788832110.809880:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832110.809970:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218375552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832110.809977:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788832110.810094:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc05c00 x1875726218375552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832110.810517:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218375552:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788832111.063555:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832111.318865:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788832111.318889:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218375680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788832111.318971:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832111.319147:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218375680 00000100:00100000:3.0:1788832111.319171:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218375680 00000100:00100000:3.0:1788832111.319231:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788832111.319241:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218375680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788832111.319269:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832111.319336:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218375680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832111.319344:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788832111.319439:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36c89180 x1875726218375680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832111.319458:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218375680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832111.831951:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832111.831978:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218375808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832111.832051:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832111.832160:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218375808 00000100:00100000:3.0:1788832111.832168:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218375808 00000100:00100000:3.0:1788832111.832219:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788832111.832227:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218375808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788832111.832248:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832111.832296:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218375808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832111.832303:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788832111.832439:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc04a80 x1875726218375808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832111.832456:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218375808:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788832112.088211:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832113.121358:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832113.370791:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832113.370845:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832113.370884:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832113.370918:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202578816 00000100:00100000:0.0:1788832113.370946:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202578816 00000100:00100000:0.0:1788832113.371004:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202578944 00000100:00100000:0.0:1788832113.371008:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202578944 00000100:00100000:0.0:1788832113.371032:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 105 00000100:00100000:0.0:1788832113.371041:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+6:2395:x1875726202578816:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832113.371115:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+6:2395:x1875726202578816:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 75us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832113.371122:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 105 00000100:00100000:0.0:1788832113.371139:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 106 00000100:00100000:0.0:1788832113.371146:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202578944:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832113.371171:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202578944:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832113.371178:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 106 00000100:00100000:2.0:1788832113.371242:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202578688 00000100:00100000:2.0:1788832113.371247:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202578688 00000100:00100000:2.0:1788832113.371284:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 283 00000100:00100000:2.0:1788832113.371292:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+10:2395:x1875726202578688:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832113.371318:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+10:2395:x1875726202578688:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832113.371324:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 283 00000100:00080000:3.0:1788832113.371600:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788832113.371606:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788832114.136328:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832114.391363:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788832114.391541:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218375936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788832114.391612:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832114.391864:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218375936 00000100:00100000:3.0:1788832114.391873:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218375936 00000100:00100000:3.0:1788832114.391930:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788832114.392059:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218375936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788832114.392099:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788832114.392177:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218375936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832114.392238:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218375936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788832114.392568:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788832114.904402:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218376064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788832114.904480:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832114.904548:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218376064 00000100:00100000:1.0:1788832114.904561:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218376064 00000100:00100000:1.0:1788832114.904644:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788832114.904654:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218376064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788832114.904688:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788832114.904743:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218376064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832114.904750:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788832114.904881:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218376064:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788832115.160019:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832115.415336:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218376192:0@lo:400:kworker.0 00000100:00100000:1.0:1788832115.415429:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832115.418200:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218376320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832115.418278:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832115.418980:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218376320 00000100:00100000:1.0:1788832115.418991:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218376320 00000100:00100000:1.0:1788832115.419063:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788832115.419075:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218376320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788832115.419107:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832115.419166:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218376320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832115.419173:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788832115.419194:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788832115.419229:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc06d80 x1875726218376320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832115.419250:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218376320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832115.420703:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218376192 00000100:00100000:2.0:1788832115.420713:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218376192 00000100:00100000:2.0:1788832115.420761:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788832115.420770:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3654:x1875726218376192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832115.420841:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3654:x1875726218376192:12345-0@lo:400:kworker.0 Request processed in 72us (5412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832115.420847:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788832115.422223:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218376192:0@lo:400:kworker.0 00000100:00100000:1.0:1788832115.422511:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875726218376448:0@lo:400:kworker.0 00000100:00100000:1.0:1788832115.422565:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832115.422644:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218376448 00000100:00100000:2.0:1788832115.422651:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218376448 00000100:00100000:2.0:1788832115.422698:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788832115.422707:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875726218376448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.426882:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218376576:0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.426953:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832115.427035:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788832115.427042:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218376704:0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.427069:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832115.427099:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218376704 00000100:00100000:0.0:1788832115.427105:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218376704 00000100:00100000:3.0:1788832115.427175:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218376576 00000100:00100000:3.0:1788832115.427190:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218376576 00000100:00100000:3.0:1788832115.427223:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788832115.427231:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218376576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832115.427296:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218376576:12345-0@lo:400:kworker.0 Request processed in 65us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832115.427303:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788832115.427585:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788832115.427593:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218376704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.427649:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218376704:12345-0@lo:400:kworker.0 Request processed in 58us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832115.427656:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788832115.427690:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218376704:0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.427708:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218376576:0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.427762:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218377088:0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.427789:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832115.427813:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218377088 00000100:00100000:0.0:1788832115.427816:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218377088 00000100:00100000:0.0:1788832115.427844:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788832115.427849:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218377088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.427878:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218377088:12345-0@lo:400:kworker.0 Request processed in 29us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832115.427884:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:0.0:1788832115.427910:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c1fe3b480 x1875726218377088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832115.427920:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218377088:0@lo:400:kworker.0 00000100:00080000:0.0:1788832115.427934:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788832115.427942:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218376832:0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.427967:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832115.427985:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788832115.427991:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218376960:0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.428012:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832115.428032:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218376832 00000100:00100000:0.0:1788832115.428036:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218376832 00000100:00100000:0.0:1788832115.428058:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788832115.428064:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218376832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.428097:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218376832:12345-0@lo:400:kworker.0 Request processed in 33us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832115.428155:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218376960 00000100:00100000:3.0:1788832115.428158:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218376960 00000100:00100000:3.0:1788832115.428185:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788832115.428191:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218376960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832115.428220:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218376960:12345-0@lo:400:kworker.0 Request processed in 29us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832115.428225:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788832115.428824:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1788832115.428850:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832115.428874:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218376960:0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.428884:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218376832:0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.428926:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788832115.428934:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218377216:0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.428967:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832115.428997:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218377216 00000100:00100000:0.0:1788832115.429001:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218377216 00000100:00100000:0.0:1788832115.429036:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788832115.429042:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218377216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.429078:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218377216:12345-0@lo:400:kworker.0 Request processed in 36us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832115.429084:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788832115.429112:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3e776680 x1875726218377216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832115.429136:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218377216:0@lo:400:kworker.0 00000100:00080000:0.0:1788832115.429150:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788832115.429187:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218377600:0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.429212:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832115.429237:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218377600 00000100:00100000:0.0:1788832115.429241:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218377600 00000100:00100000:0.0:1788832115.429268:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788832115.429274:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218377600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.429308:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218377600:12345-0@lo:400:kworker.0 Request processed in 34us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832115.429323:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:0.0:1788832115.429362:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcbaa00 x1875726218377600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832115.429372:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218377600:0@lo:400:kworker.0 00000100:00080000:0.0:1788832115.429384:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788832115.429391:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218377344:0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.429414:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832115.429432:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788832115.429437:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1875726218377472:0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.429458:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832115.429480:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218377344 00000100:00100000:0.0:1788832115.429483:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218377344 00000100:00100000:0.0:1788832115.429509:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788832115.429515:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218377344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.429549:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218377344:12345-0@lo:400:kworker.0 Request processed in 33us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832115.429555:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788832115.430295:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218377472 00000100:00100000:0.0:1788832115.430303:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218377472 00000100:00100000:0.0:1788832115.430352:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788832115.430360:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875726218377472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.430404:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875726218377472:12345-0@lo:400:kworker.0 Request processed in 46us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832115.430411:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1788832115.430434:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788832115.430446:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788832115.430470:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e775f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1875726218377472:0@lo:400:kworker.0 00010000:00080000:0.0:1788832115.430482:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3e776680 x1875726218377344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832115.430492:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218377344:0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.430534:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788832115.430542:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218377728:0@lo:400:kworker.0 00000100:00100000:2.0:1788832115.432219:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875726218376448:12345-0@lo:400:kworker.0 Request processed in 9507us (9646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832115.432231:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788832115.432556:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875726218376448:0@lo:400:kworker.0 00000100:00100000:0.0:1788832115.434516:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832115.434687:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218377728 00000100:00100000:1.0:1788832115.434696:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218377728 00000100:00100000:1.0:1788832115.434771:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788832115.434781:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218377728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832115.434862:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218377728:12345-0@lo:400:kworker.0 Request processed in 83us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832115.434868:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788832115.434930:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b070b9c00 x1875726218377728/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832115.434944:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218377728:0@lo:400:kworker.0 00000100:00080000:0.0:1788832115.435360:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788832115.929117:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218377856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788832115.929198:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832115.929273:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218377856 00000100:00100000:0.0:1788832115.929281:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218377856 00000100:00100000:0.0:1788832115.929337:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788832115.929348:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218377856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788832115.929375:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832115.929418:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218377856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832115.929425:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788832115.929465:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b070bbb80 x1875726218377856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832115.929484:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218377856:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788832116.182947:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832116.444442:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218377984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788832116.444516:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832116.448566:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218377984 00000100:00100000:1.0:1788832116.448586:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218377984 00000100:00100000:1.0:1788832116.448911:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788832116.448922:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218377984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788832116.448957:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832116.451225:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218377984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2295us (6698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832116.451241:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1788832116.454698:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc06680 x1875726218377984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832116.454984:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218377984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788832116.951999:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218378112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788832116.952086:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832116.953121:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218378112 00000100:00100000:1.0:1788832116.953131:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218378112 00000100:00100000:1.0:1788832116.953192:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788832116.953202:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218378112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832116.953227:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832116.953291:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218378112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832116.953298:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788832116.953461:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36c89f80 x1875726218378112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832116.953481:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218378112:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788832117.206787:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832118.231712:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832118.486908:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832118.486947:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832118.487237:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202579072 00000100:00100000:0.0:1788832118.487247:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202579072 00000100:00100000:0.0:1788832118.487296:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 285 00000100:00100000:0.0:1788832118.487305:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+10:2395:x1875726202579072:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832118.487382:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+10:2395:x1875726202579072:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 78us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832118.487390:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 285 00000100:00100000:3.0:1788832118.489114:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202579200 00000100:00100000:3.0:1788832118.489124:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202579200 00000100:00100000:3.0:1788832118.489190:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 113 00000100:00100000:3.0:1788832118.489200:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+6:2395:x1875726202579200:12345-192.168.203.26@tcp:400:kworker.0 00000100:00080000:1.0:1788832118.489314:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832118.493450:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+6:2395:x1875726202579200:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 4241us (6491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832118.493466:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 113 00000100:00100000:2.0:1788832118.495359:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832118.495491:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202579328 00000100:00100000:2.0:1788832118.495500:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202579328 00000100:00100000:2.0:1788832118.495555:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 114 00000100:00100000:2.0:1788832118.495565:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202579328:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832118.496041:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202579328:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 475us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832118.496049:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 114 00000100:00080000:2.0:1788832118.496071:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788832119.257098:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832119.511109:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788832119.514946:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218378240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788832119.515030:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832119.515396:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218378240 00000100:00100000:2.0:1788832119.515405:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218378240 00000100:00100000:2.0:1788832119.515452:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788832119.515463:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218378240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788832119.515500:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788832119.515576:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218378240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832119.515583:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788832119.515791:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218378240:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788832120.025049:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218378368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788832120.025122:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832120.025267:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218378368 00000100:00100000:3.0:1788832120.025274:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218378368 00000100:00100000:3.0:1788832120.025336:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788832120.025346:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218378368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788832120.025380:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788832120.025431:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218378368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832120.025438:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788832120.026126:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218378368:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788832120.279634:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832120.535060:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788832120.535084:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218378496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832120.535159:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832120.535331:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218378496 00000100:00100000:3.0:1788832120.535340:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218378496 00000100:00100000:3.0:1788832120.535407:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788832120.535418:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218378496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788832120.535447:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832120.535493:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218378496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832120.535501:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788832120.535582:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc06680 x1875726218378496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832120.535601:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218378496:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788832120.535756:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788832120.535924:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218379008:0@lo:400:kworker.0 00000100:00100000:2.0:1788832120.535959:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832120.535981:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218379520:0@lo:400:kworker.0 00000100:00100000:2.0:1788832120.536027:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832120.536055:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788832120.536061:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218378880:0@lo:400:kworker.0 00000100:00100000:2.0:1788832120.536085:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832120.536098:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218379392:0@lo:400:kworker.0 00000100:00100000:2.0:1788832120.536115:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832120.536128:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218379904:0@lo:400:kworker.0 00000100:00100000:2.0:1788832120.536144:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832120.536185:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218379520 00000100:00100000:2.0:1788832120.536189:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218379520 00000100:00100000:2.0:1788832120.536220:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218379392 00000100:00100000:2.0:1788832120.536223:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218379392 00000100:00100000:2.0:1788832120.536240:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218379904 00000100:00100000:2.0:1788832120.536243:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218379904 00000100:00100000:2.0:1788832120.536259:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788832120.536266:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218379520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832120.536319:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218379520:12345-0@lo:400:kworker.0 Request processed in 53us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832120.536325:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788832120.536339:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788832120.536345:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218379392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832120.536370:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218379392:12345-0@lo:400:kworker.0 Request processed in 26us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832120.536375:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788832120.536384:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788832120.536389:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218379904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832120.536409:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218379904:12345-0@lo:400:kworker.0 Request processed in 20us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832120.536415:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788832120.536437:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218379008 00000100:00100000:2.0:1788832120.536441:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218379008 00000100:00100000:2.0:1788832120.536460:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788832120.536466:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218379008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832120.536494:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218379008:12345-0@lo:400:kworker.0 Request processed in 29us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832120.536500:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:2.0:1788832120.536534:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36c89c00 x1875726218379392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832120.536545:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218379392:0@lo:400:kworker.0 00010000:00080000:2.0:1788832120.536555:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36c8b800 x1875726218379904/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832120.536563:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218379904:0@lo:400:kworker.0 00000100:00100000:2.0:1788832120.536572:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218379008:0@lo:400:kworker.0 00010000:00080000:2.0:1788832120.536580:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36c8aa00 x1875726218379520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832120.536588:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218379520:0@lo:400:kworker.0 00000100:00100000:0.0:1788832120.536743:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875726218378752:0@lo:400:kworker.0 00000100:00100000:0.0:1788832120.536771:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832120.536790:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218379264:0@lo:400:kworker.0 00000100:00100000:0.0:1788832120.536806:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832120.536824:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218379776:0@lo:400:kworker.0 00000100:00100000:0.0:1788832120.536851:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832120.536866:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788832120.536871:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218378624:0@lo:400:kworker.0 00000100:00100000:0.0:1788832120.536892:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832120.536913:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218379136:0@lo:400:kworker.0 00000100:00100000:0.0:1788832120.536931:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832120.536940:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1875726218379648:0@lo:400:kworker.0 00000100:00100000:0.0:1788832120.536958:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832120.536977:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218378880 00000100:00100000:0.0:1788832120.536981:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218378880 00000100:00100000:0.0:1788832120.537000:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218378752 00000100:00100000:0.0:1788832120.537002:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218378752 00000100:00100000:0.0:1788832120.537011:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218379264 00000100:00100000:0.0:1788832120.537013:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218379264 00000100:00100000:0.0:1788832120.537023:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218379776 00000100:00100000:0.0:1788832120.537025:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218379776 00000100:00100000:0.0:1788832120.537034:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218379136 00000100:00100000:0.0:1788832120.537036:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218379136 00000100:00100000:0.0:1788832120.537045:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218379648 00000100:00100000:0.0:1788832120.537047:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218379648 00000100:00100000:0.0:1788832120.537058:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788832120.537064:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218378880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832120.537099:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218378880:12345-0@lo:400:kworker.0 Request processed in 35us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832120.537106:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788832120.537117:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788832120.537122:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875726218378752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832120.537146:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875726218378752:12345-0@lo:400:kworker.0 Request processed in 24us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832120.537158:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788832120.537172:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788832120.537177:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218379264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832120.537204:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218379264:12345-0@lo:400:kworker.0 Request processed in 27us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832120.537210:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788832120.537221:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788832120.537226:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218379776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832120.537251:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218379776:12345-0@lo:400:kworker.0 Request processed in 25us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832120.537256:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788832120.537266:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788832120.537272:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218379136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832120.537308:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218379136:12345-0@lo:400:kworker.0 Request processed in 36us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832120.537313:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788832120.537324:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788832120.537329:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875726218379648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832120.537354:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875726218379648:12345-0@lo:400:kworker.0 Request processed in 26us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832120.537359:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788832120.537377:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218378624 00000100:00100000:0.0:1788832120.537380:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218378624 00000100:00100000:0.0:1788832120.537402:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788832120.537408:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3654:x1875726218378624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832120.537443:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3654:x1875726218378624:12345-0@lo:400:kworker.0 Request processed in 35us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832120.537449:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788832120.537488:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218378624:0@lo:400:kworker.0 00000100:00100000:0.0:1788832120.537499:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218379136:0@lo:400:kworker.0 00000100:00100000:0.0:1788832120.537507:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1875726218379648:0@lo:400:kworker.0 00000100:00100000:0.0:1788832120.537515:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875726218378752:0@lo:400:kworker.0 00010000:00080000:0.0:1788832120.537525:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36c8b100 x1875726218379264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832120.537535:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218379264:0@lo:400:kworker.0 00010000:00080000:0.0:1788832120.537544:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36c88e00 x1875726218379776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832120.537552:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218379776:0@lo:400:kworker.0 00000100:00100000:0.0:1788832120.537586:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218378880:0@lo:400:kworker.0 00000100:00080000:1.0:1788832120.537702:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788832120.537706:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788832120.537709:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788832120.537711:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832121.046867:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218380032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788832121.046957:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832121.047365:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218380032 00000100:00100000:1.0:1788832121.047384:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218380032 00000100:00100000:1.0:1788832121.047450:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788832121.047460:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218380032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788832121.047483:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832121.056788:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218380032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 8149us (8650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832121.056808:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788832121.059767:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36d0d180 x1875726218380032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832121.059795:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218380032:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788832121.306470:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832121.561497:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788832121.565421:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218380160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832121.565499:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:02000400:0.0:1788832121.566592:0:11999:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 21:48:40 (1788832120) === 00000100:00100000:1.0:1788832121.567084:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218380160 00000100:00100000:1.0:1788832121.567094:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218380160 00000100:00100000:1.0:1788832121.567150:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788832121.567161:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218380160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788832121.567200:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832121.567272:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218380160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (1773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832121.567280:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1788832121.567343:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc06d80 x1875726218380160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832121.567365:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218380160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832122.071347:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832122.071370:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218380288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832122.071444:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832122.071523:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218380288 00000100:00100000:2.0:1788832122.071531:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218380288 00000100:00100000:2.0:1788832122.071587:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788832122.071597:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218380288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788832122.071640:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788832122.071705:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218380288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832122.071712:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788832122.071735:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788832122.071767:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36c92a00 x1875726218380288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832138 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832122.071785:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218380288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832122.075225:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832122.075347:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202579456 00000100:00100000:0.0:1788832122.075359:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202579456 00000100:00100000:0.0:1788832122.075421:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 287 00000100:00100000:0.0:1788832122.075431:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+10:8729:x1875726202579456:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788832122.075448:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832122.075468:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c36db9c00/0x998c12b283537096 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0456f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832122.075517:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c36db9c00/0x998c12b283537096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0456f expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832122.075530:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c36db9c00/0x998c12b283537096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0456f expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832122.075541:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c36db9c00, rc 0) 00000100:00100000:0.0:1788832122.075604:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+11:8729:x1875726202579456:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 175us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832122.075612:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 287 00000100:00100000:1.0:1788832122.080069:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832122.080222:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202579584 00000100:00100000:0.0:1788832122.080232:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202579584 00000100:00100000:0.0:1788832122.080295:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 288 00000100:00100000:0.0:1788832122.080306:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+11:8729:x1875726202579584:12345-192.168.203.26@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788832122.080468:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+11:8729:x1875726202579584:12345-192.168.203.26@tcp:501:mount.lustre.0 Request processed in 163us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832122.080477:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 288 00000100:00100000:2.0:1788832122.087538:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832122.087669:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202579712 00000100:00100000:1.0:1788832122.087680:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202579712 00000100:00100000:1.0:1788832122.087749:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 289 00000100:00100000:1.0:1788832122.087760:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+11:8729:x1875726202579712:12345-192.168.203.26@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788832122.087932:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+11:8729:x1875726202579712:12345-192.168.203.26@tcp:503:mount.lustre.0 Request processed in 174us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832122.087940:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 289 00000100:00100000:3.0:1788832122.093953:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832122.098082:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202579840 00000100:00100000:2.0:1788832122.098096:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202579840 00000100:00100000:2.0:1788832122.098227:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 290 00000100:00100000:2.0:1788832122.098238:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+11:8733:x1875726202579840:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788832122.098429:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+11:8733:x1875726202579840:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 192us (4483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832122.098437:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 290 00000100:00100000:3.0:1788832122.137861:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832122.137972:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202579968 00000100:00100000:0.0:1788832122.137986:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202579968 00000100:00100000:0.0:1788832122.138057:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 291 00000100:00100000:0.0:1788832122.138067:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+11:8733:x1875726202579968:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788832122.138239:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+11:8733:x1875726202579968:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 172us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832122.138247:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 291 00000100:00100000:0.0:1788832122.146829:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832122.146972:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202580096 00000100:00100000:2.0:1788832122.146989:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202580096 00000100:00100000:2.0:1788832122.147123:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 292 00000100:00100000:2.0:1788832122.147137:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+11:8733:x1875726202580096:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788832122.147328:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+11:8733:x1875726202580096:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 193us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832122.147337:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 292 00000100:00100000:3.0:1788832122.155779:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832122.156832:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202580224 00000100:00100000:1.0:1788832122.156847:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202580224 00000100:00100000:1.0:1788832122.156915:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 293 00000100:00100000:1.0:1788832122.156925:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+11:8729:x1875726202580224:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788832122.156942:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832122.156959:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c390f3600/0x998c12b28353709d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc045a0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832122.156988:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c390f3600/0x998c12b28353709d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045a0 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832122.156999:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c390f3600/0x998c12b28353709d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045a0 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832122.157007:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c390f3600, rc 0) 00000100:00100000:1.0:1788832122.157070:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+12:8729:x1875726202580224:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 147us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832122.157077:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 293 00000100:00100000:3.0:1788832122.163311:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832122.163471:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202580352 00000100:00100000:1.0:1788832122.163485:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202580352 00000100:00100000:1.0:1788832122.163550:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 294 00000100:00100000:1.0:1788832122.163561:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+12:8729:x1875726202580352:12345-192.168.203.26@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788832122.163607:0:6519:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788832122.163671:0:6519:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788832122.163676:0:6519:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788832122.163680:0:6519:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788832122.163683:0:6519:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788832122.163685:0:6519:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788832122.165852:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+12:8729:x1875726202580352:12345-192.168.203.26@tcp:256:mount.lustre.0 Request processed in 2276us (2541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832122.165870:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 294 00000100:00100000:3.0:1788832122.172789:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832122.174017:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202580480 00000100:00100000:0.0:1788832122.174037:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202580480 00000100:00100000:1.0:1788832122.174328:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 295 00000100:00100000:1.0:1788832122.174343:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+12:8729:x1875726202580480:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788832122.174367:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832122.174393:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c390f2400/0x998c12b2835370a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc045a7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832122.174432:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c390f2400/0x998c12b2835370a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045a7 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832122.174445:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c390f2400/0x998c12b2835370a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045a7 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832122.174455:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c390f2400, rc 0) 00000100:00100000:1.0:1788832122.174668:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:8729:x1875726202580480:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 325us (1890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832122.174676:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 295 00000100:00100000:3.0:1788832122.178441:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832122.179028:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202580608 00000100:00100000:1.0:1788832122.179043:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202580608 00000100:00100000:1.0:1788832122.179167:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 296 00000100:00100000:1.0:1788832122.179181:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:8729:x1875726202580608:12345-192.168.203.26@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788832122.179422:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:8729:x1875726202580608:12345-192.168.203.26@tcp:501:mount.lustre.0 Request processed in 244us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832122.179431:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 296 00000100:00100000:3.0:1788832122.185063:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832122.190015:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202580736 00000100:00100000:1.0:1788832122.190061:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202580736 00000100:00100000:1.0:1788832122.190152:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 297 00000100:00100000:1.0:1788832122.190162:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:8729:x1875726202580736:12345-192.168.203.26@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788832122.190386:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:8729:x1875726202580736:12345-192.168.203.26@tcp:503:mount.lustre.0 Request processed in 224us (5339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832122.190396:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 297 00000100:00100000:3.0:1788832122.195153:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832122.196369:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202580864 00000100:00100000:0.0:1788832122.196386:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202580864 00000100:00100000:0.0:1788832122.197886:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 298 00000100:00100000:0.0:1788832122.197914:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:8739:x1875726202580864:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788832122.198146:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:8739:x1875726202580864:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 244us (3017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832122.198155:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 298 00000100:00100000:3.0:1788832122.202964:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832122.203434:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202580992 00000100:00100000:2.0:1788832122.203448:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202580992 00000100:00100000:1.0:1788832122.203743:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 299 00000100:00100000:1.0:1788832122.203761:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:8739:x1875726202580992:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788832122.209638:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:8739:x1875726202580992:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 5851us (6657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832122.209659:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 299 00000100:00100000:0.0:1788832122.217056:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832122.217100:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832122.217140:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832122.217180:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832122.217444:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202581120 00000100:00100000:3.0:1788832122.217457:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202581120 00000100:00100000:3.0:1788832122.217496:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202581376 00000100:00100000:3.0:1788832122.217498:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202581376 00000100:00100000:3.0:1788832122.217505:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202581760 00000100:00100000:3.0:1788832122.217507:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202581760 00000100:00100000:3.0:1788832122.217552:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202581888 00000100:00100000:3.0:1788832122.217554:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202581888 00000100:00100000:3.0:1788832122.217574:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 121 00000100:00100000:3.0:1788832122.217584:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+6:2396:x1875726202581760:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832122.217810:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+6:2396:x1875726202581760:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 225us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832122.217820:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 121 00000100:00100000:1.0:1788832122.217828:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 122 00000100:00100000:3.0:1788832122.217845:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:1.0:1788832122.217856:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202581888:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832122.217892:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202581888:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 54us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832122.217899:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 122 00000100:00100000:1.0:1788832122.217915:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:1.0:1788832122.217920:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875726202581376:12345-192.168.203.26@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788832122.217951:0:6525:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from c5983f70-61a6-4df8-ba8a-04bd100176c7@192.168.203.26@tcp t0 exp 0000000000000000 cur 262 last 0 00000100:00080000:0.0:1788832122.217951:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788832122.217955:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1788832122.218023:0:6525:0:(genops.c:1385:class_connect()) connect: client c5983f70-61a6-4df8-ba8a-04bd100176c7, cookie 0x998c12b2835370ab 00000004:00100000:0.0:1788832122.218056:0:6525:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788832122.218209:0:6525:0:(import.c:65:import_set_state_nolock()) ffff9d2c36d27800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788832122.218245:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:2392:x1875726202581376:12345-192.168.203.26@tcp:38:mount.lustre.0 Request processed in 323us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832122.218253:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:3.0:1788832122.218377:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1875726202581120:12345-192.168.203.26@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788832122.218397:0:8742:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c5983f70-61a6-4df8-ba8a-04bd100176c7@192.168.203.26@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:3.0:1788832122.218422:0:8742:0:(genops.c:1385:class_connect()) connect: client c5983f70-61a6-4df8-ba8a-04bd100176c7, cookie 0x998c12b2835370b2 00000004:00100000:3.0:1788832122.218439:0:8742:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788832122.218505:0:8742:0:(import.c:65:import_set_state_nolock()) ffff9d2b076ee800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788832122.218543:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:2392:x1875726202581120:12345-192.168.203.26@tcp:38:mount.lustre.0 Request processed in 689us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832122.218571:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:2.0:1788832122.231452:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832122.231580:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832122.232176:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832122.232480:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202581504 00000100:00100000:0.0:1788832122.232496:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202581504 00000100:00100000:0.0:1788832122.232589:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202581248 00000100:00100000:0.0:1788832122.232593:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202581248 00000100:00100000:0.0:1788832122.232676:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:0.0:1788832122.232689:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:0:x1875726202581504:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788832122.232746:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788832122.232856:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:0:x1875726202581504:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 169us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832122.232863:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:0.0:1788832122.233177:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:0.0:1788832122.233187:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:0:x1875726202581248:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788832122.233233:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788832122.233293:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:0:x1875726202581248:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 97us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832122.233301:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00080000:1.0:1788832122.233537:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788832122.233542:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788832122.239771:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202581632 00000100:00100000:3.0:1788832122.239795:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202581632 00000100:00100000:1.0:1788832122.240143:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:1.0:1788832122.240162:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:8729:x1875726202581632:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788832122.240209:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788832122.243320:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:8729:x1875726202581632:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 3143us (11124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832122.243362:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:0.0:1788832122.258393:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832122.258590:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202582016 00000100:00100000:2.0:1788832122.258604:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202582016 00000100:00100000:2.0:1788832122.258722:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:2.0:1788832122.258733:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:8729:x1875726202582016:12345-192.168.203.26@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788832122.258850:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:8729:x1875726202582016:12345-192.168.203.26@tcp:40:mount.lustre.0 Request processed in 118us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832122.258859:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:2.0:1788832122.260992:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832122.261150:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832122.261197:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832122.261299:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202582144 00000100:00100000:0.0:1788832122.261311:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202582144 00000100:00100000:0.0:1788832122.261356:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202582272 00000100:00100000:0.0:1788832122.261363:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202582272 00000100:00100000:0.0:1788832122.261390:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:2.0:1788832122.261404:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:0.0:1788832122.261404:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875726202582144:12345-192.168.203.26@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788832122.261448:0:8442:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c5983f70-61a6-4df8-ba8a-04bd100176c7@192.168.203.26@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:0.0:1788832122.261488:0:8442:0:(genops.c:1385:class_connect()) connect: client c5983f70-61a6-4df8-ba8a-04bd100176c7, cookie 0x998c12b2835370b9 00002000:00100000:0.0:1788832122.261505:0:8442:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c5983f70-61a6-4df8-ba8a-04bd100176c7/ffff9d2b073a0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788832122.261519:0:8442:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788832122.261572:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1875726202582272:12345-192.168.203.26@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788832122.261593:0:10097:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c5983f70-61a6-4df8-ba8a-04bd100176c7@192.168.203.26@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:2.0:1788832122.261613:0:10097:0:(genops.c:1385:class_connect()) connect: client c5983f70-61a6-4df8-ba8a-04bd100176c7, cookie 0x998c12b2835370c0 00002000:00080000:0.0:1788832122.261799:0:8442:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788832122.261841:0:8442:0:(import.c:65:import_set_state_nolock()) ffff9d2b073a2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788832122.261955:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:2392:x1875726202582144:12345-192.168.203.26@tcp:8:mount.lustre.0 Request processed in 554us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832122.261963:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00002000:00100000:2.0:1788832122.262315:0:10097:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c5983f70-61a6-4df8-ba8a-04bd100176c7/ffff9d2c3fc35000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788832122.262338:0:10097:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788832122.262988:0:10097:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788832122.263034:0:10097:0:(import.c:65:import_set_state_nolock()) ffff9d2b076ec800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788832122.263106:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:2392:x1875726202582272:12345-192.168.203.26@tcp:8:mount.lustre.0 Request processed in 1534us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832122.263115:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:1.0:1788832122.264434:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202582400 00000100:00100000:1.0:1788832122.264451:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202582400 00000100:00100000:1.0:1788832122.264527:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:1.0:1788832122.264539:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:8729:x1875726202582400:12345-192.168.203.26@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788832122.264653:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:8729:x1875726202582400:12345-192.168.203.26@tcp:900:mount.lustre.0 Request processed in 114us (3669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832122.264662:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:0.0:1788832122.266558:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832122.266873:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202582528 00000100:00100000:2.0:1788832122.266890:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202582528 00000100:00100000:2.0:1788832122.266967:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:2.0:1788832122.266982:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:8729:x1875726202582528:12345-192.168.203.26@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788832122.267116:0:6528:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788832122.267410:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:8729:x1875726202582528:12345-192.168.203.26@tcp:33:mount.lustre.0 Request processed in 430us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832122.267442:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1 00010000:00010000:2.0:1788832122.327764:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832123.350904:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832124.378341:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832124.632001:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218380416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832124.632116:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832124.632221:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218380416 00000100:00100000:2.0:1788832124.632231:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218380416 00000100:00100000:2.0:1788832124.632295:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788832124.632307:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218380416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788832124.632347:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788832124.632399:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218380416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832124.632406:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788832124.632464:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218380416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832125.148488:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218380544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788832125.148591:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832125.148820:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218380544 00000100:00100000:3.0:1788832125.148833:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218380544 00000100:00100000:3.0:1788832125.148918:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788832125.148972:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218380544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788832125.149477:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788832125.149580:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218380544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 651us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832125.149591:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788832125.149965:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218380544:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788832125.398955:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832125.656856:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832125.656888:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b073bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218380672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832125.656979:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832125.658109:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218380672 00000100:00100000:2.0:1788832125.658123:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218380672 00000100:00100000:2.0:1788832125.658211:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788832125.658225:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218380672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788832125.658278:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788832125.658376:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218380672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832125.658404:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788832125.658438:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218381184:0@lo:400:kworker.0 00000100:00100000:2.0:1788832125.658444:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218381056:0@lo:400:kworker.0 00000100:00100000:0.0:1788832125.658494:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832125.658501:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832125.658532:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218381696:0@lo:400:kworker.0 00000100:00100000:2.0:1788832125.658535:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218381568:0@lo:400:kworker.0 00000100:00100000:0.0:1788832125.658574:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832125.658585:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218381184 00000100:00100000:2.0:1788832125.658590:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218381184 00000100:00100000:0.0:1788832125.658608:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788832125.658617:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218380800:0@lo:400:kworker.0 00000100:00100000:2.0:1788832125.658651:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788832125.658663:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218381184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832125.658688:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832125.658717:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218381184:12345-0@lo:400:kworker.0 Request processed in 56us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832125.658723:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218381312:0@lo:400:kworker.0 00000100:00100000:2.0:1788832125.658729:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788832125.658756:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218381056 00000100:00100000:0.0:1788832125.658759:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832125.658762:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218381056 00000100:00100000:0.0:1788832125.658781:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218381824:0@lo:400:kworker.0 00000100:00100000:2.0:1788832125.658795:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218381312 00000100:00100000:2.0:1788832125.658801:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218381312 00000100:00100000:0.0:1788832125.658807:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832125.658825:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218381824 00000100:00100000:2.0:1788832125.658830:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218381824 00000100:00100000:2.0:1788832125.658851:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788832125.658854:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218381184:0@lo:400:kworker.0 00000100:00100000:2.0:1788832125.658861:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218381056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832125.658895:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218380800 00000100:00100000:0.0:1788832125.658900:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218380800 00000100:00100000:2.0:1788832125.658904:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218381056:12345-0@lo:400:kworker.0 Request processed in 43us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832125.658912:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788832125.658930:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788832125.658940:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788832125.658950:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3653:x1875726218380800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832125.658954:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218381312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832125.658996:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3653:x1875726218380800:12345-0@lo:400:kworker.0 Request processed in 48us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832125.659003:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218381312:12345-0@lo:400:kworker.0 Request processed in 64us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832125.659008:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788832125.659026:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788832125.659046:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1788832125.659102:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832125.659120:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218381824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832125.659158:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218381824:12345-0@lo:400:kworker.0 Request processed in 104us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832125.659218:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832125.659244:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218382080:0@lo:400:kworker.0 00000100:00100000:2.0:1788832125.659281:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832125.659301:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218381696 00000100:00100000:3.0:1788832125.659307:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218381696 00000100:00100000:2.0:1788832125.659320:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218381056:0@lo:400:kworker.0 00000100:00100000:3.0:1788832125.659345:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218381568 00000100:00100000:3.0:1788832125.659350:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218381568 00000100:00100000:3.0:1788832125.659368:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218382080 00000100:00100000:3.0:1788832125.659371:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218382080 00000100:00100000:3.0:1788832125.659387:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788832125.659391:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788832125.659397:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218381696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832125.659404:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875726218380928:0@lo:400:kworker.0 00000100:00100000:2.0:1788832125.659449:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832125.659455:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218381696:12345-0@lo:400:kworker.0 Request processed in 61us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832125.659464:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788832125.659473:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1875726218381440:0@lo:400:kworker.0 00000100:00100000:3.0:1788832125.659491:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788832125.659499:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218381568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832125.659504:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832125.659526:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218381952:0@lo:400:kworker.0 00000100:00100000:3.0:1788832125.659542:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218381568:12345-0@lo:400:kworker.0 Request processed in 44us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832125.659550:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788832125.659558:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832125.659566:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788832125.659576:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218382080:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788832125.659587:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0771ed80 x1875726218381568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832125.659602:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218381568:0@lo:400:kworker.0 00000100:00100000:3.0:1788832125.659610:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218382080:12345-0@lo:400:kworker.0 Request processed in 35us (327us total) trans 0 rc 0/0 00010000:00080000:2.0:1788832125.659639:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcb6300 x1875726218382080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832125.659652:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788832125.659652:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218382080:0@lo:400:kworker.0 00000100:00100000:3.0:1788832125.659701:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218380928 00000100:00100000:3.0:1788832125.659706:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218380928 00000100:00100000:0.0:1788832125.660439:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788832125.660467:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218381440 00000100:00100000:0.0:1788832125.660473:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218381440 00000100:00100000:0.0:1788832125.660501:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218381952 00000100:00100000:0.0:1788832125.660504:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218381952 00000100:00100000:0.0:1788832125.660520:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788832125.660527:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875726218381440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832125.660593:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875726218381440:12345-0@lo:400:kworker.0 Request processed in 67us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832125.660600:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788832125.660610:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788832125.660616:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875726218381952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832125.660656:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875726218381952:12345-0@lo:400:kworker.0 Request processed in 40us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832125.660661:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788832125.660695:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218380800:0@lo:400:kworker.0 00000100:00100000:0.0:1788832125.660721:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218381312:0@lo:400:kworker.0 00000100:00100000:0.0:1788832125.660734:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218381824:0@lo:400:kworker.0 00010000:00080000:0.0:1788832125.660749:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcb4e00 x1875726218381696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832125.660760:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218381696:0@lo:400:kworker.0 00010000:00080000:2.0:1788832125.660990:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0771df80 x1875726218381440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832125.661003:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1875726218381440:0@lo:400:kworker.0 00010000:00080000:2.0:1788832125.661015:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcb5f80 x1875726218381952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832125.661038:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218381952:0@lo:400:kworker.0 00010000:00080000:0.0:1788832125.661344:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b073bdf80 x1875726218380672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832125.661373:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b073bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218380672:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788832125.661474:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788832125.661478:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788832125.661481:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788832125.663303:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788832125.663319:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875726218380928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832125.664216:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875726218380928:12345-0@lo:400:kworker.0 Request processed in 894us (4760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832125.664229:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788832125.664294:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875726218380928:0@lo:400:kworker.0 00000100:00100000:2.0:1788832126.174827:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218382208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788832126.174929:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832126.175188:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218382208 00000100:00100000:3.0:1788832126.175200:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218382208 00000100:00100000:3.0:1788832126.175279:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788832126.175291:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218382208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788832126.175321:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832126.175393:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218382208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832126.175401:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1788832126.175501:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc06680 x1875726218382208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832126.175523:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218382208:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788832126.422864:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832126.681191:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218382336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788832126.681311:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832126.681487:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218382336 00000100:00100000:2.0:1788832126.681512:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218382336 00000100:00100000:2.0:1788832126.681601:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788832126.681614:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218382336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788832126.681706:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788832126.682313:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218382336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 698us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832126.682324:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1788832126.682554:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc05c00 x1875726218382336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832126.682581:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218382336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788832127.191120:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218382464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788832127.191220:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832127.191400:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218382464 00000100:00100000:1.0:1788832127.191411:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218382464 00000100:00100000:1.0:1788832127.191500:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788832127.191514:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218382464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832127.191553:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788832127.191665:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832127.193081:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218382464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1562us (1852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832127.193117:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1788832127.193226:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc05c00 x1875726218382464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832143 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832127.193265:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218382464:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788832127.449365:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832127.700549:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832127.700616:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832127.700671:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832127.700702:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832127.700724:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832127.700745:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832127.700771:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832127.700803:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202583296 00000100:00100000:3.0:1788832127.700817:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202583296 00000100:00100000:3.0:1788832127.700902:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202583424 00000100:00100000:3.0:1788832127.700905:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202583424 00000100:00100000:3.0:1788832127.700934:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:3.0:1788832127.700946:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:2395:x1875726202583296:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832127.701054:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:2395:x1875726202583296:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 109us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832127.701063:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:3.0:1788832127.701083:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:3.0:1788832127.701090:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:2395:x1875726202583424:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832127.701117:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:2395:x1875726202583424:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832127.701123:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:3.0:1788832127.701145:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202582656 00000100:00100000:3.0:1788832127.701148:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202582656 00000100:00100000:3.0:1788832127.701176:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 301 00000100:00100000:3.0:1788832127.701183:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2395:x1875726202582656:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832127.701228:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2395:x1875726202582656:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 45us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832127.701253:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 301 00000100:00100000:3.0:1788832127.701289:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202582784 00000100:00100000:3.0:1788832127.701294:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202582784 00000100:00100000:3.0:1788832127.701318:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202583040 00000100:00100000:3.0:1788832127.701321:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202583040 00000100:00100000:3.0:1788832127.701332:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202582912 00000100:00100000:3.0:1788832127.701335:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202582912 00000100:00100000:3.0:1788832127.701346:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202583168 00000100:00100000:3.0:1788832127.701348:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202583168 00000100:00100000:3.0:1788832127.701363:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 129 00000100:00100000:3.0:1788832127.701369:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+6:2395:x1875726202582784:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832127.701401:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+6:2395:x1875726202582784:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 32us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832127.701408:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 129 00000100:00100000:3.0:1788832127.701419:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 130 00000100:00100000:3.0:1788832127.701424:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:2395:x1875726202583040:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832127.701446:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:2395:x1875726202583040:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 22us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832127.701453:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 130 00000100:00100000:3.0:1788832127.701464:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 131 00000100:00100000:3.0:1788832127.701470:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202582912:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832127.701494:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202582912:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832127.701500:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 131 00000100:00100000:3.0:1788832127.701510:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 132 00000100:00100000:3.0:1788832127.701524:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:2395:x1875726202583168:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832127.701551:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:2395:x1875726202583168:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832127.701557:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 132 00000100:00080000:3.0:1788832127.701583:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788832127.701587:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788832127.701591:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788832127.701593:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1788832127.714286:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c5983f70-61a6-4df8-ba8a-04bd100176c7 00000001:00100000:2.0:1788832127.719597:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c5983f70-61a6-4df8-ba8a-04bd100176c7 00000001:00100000:1.0:1788832127.720384:0:6504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c5983f70-61a6-4df8-ba8a-04bd100176c7 00000001:00100000:3.0:1788832127.720498:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c5983f70-61a6-4df8-ba8a-04bd100176c7 00000001:02000400:1.0:1788832128.364493:0:12192:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1788832128.472936:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832129.500283:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832129.751477:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b074f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218382592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832129.751551:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832129.751690:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218382592 00000100:00100000:1.0:1788832129.751698:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218382592 00000100:00100000:1.0:1788832129.751753:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788832129.751763:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218382592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788832129.751794:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788832129.751895:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218382592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832129.751904:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788832129.751996:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b074f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218382592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788832130.263413:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218382720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788832130.263489:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832130.263649:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218382720 00000100:00100000:2.0:1788832130.263657:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218382720 00000100:00100000:2.0:1788832130.263712:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788832130.263721:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218382720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788832130.263754:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788832130.263805:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218382720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832130.263824:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788832130.264061:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218382720:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788832130.522100:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832130.775901:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218383232:0@lo:400:kworker.0 00000100:00100000:0.0:1788832130.775970:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832130.776026:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218383744:0@lo:400:kworker.0 00000100:00100000:0.0:1788832130.776051:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832130.776068:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218384256:0@lo:400:kworker.0 00000100:00100000:0.0:1788832130.776100:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832130.776132:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788832130.776138:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b074f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218382848:0@lo:400:kworker.0 00000100:00100000:0.0:1788832130.776164:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832130.776194:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218383360:0@lo:400:kworker.0 00000100:00100000:0.0:1788832130.776220:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832130.776249:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218383872:0@lo:400:kworker.0 00000100:00100000:0.0:1788832130.776268:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832130.776291:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218382976:0@lo:400:kworker.0 00000100:00100000:0.0:1788832130.776312:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832130.776328:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218383488:0@lo:400:kworker.0 00000100:00100000:0.0:1788832130.776349:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832130.776364:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218384000:0@lo:400:kworker.0 00000100:00100000:0.0:1788832130.776380:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832130.776392:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788832130.776398:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218383104:0@lo:400:kworker.0 00000100:00100000:0.0:1788832130.776419:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832130.776430:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218383616:0@lo:400:kworker.0 00000100:00100000:0.0:1788832130.776448:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832130.776472:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218384128:0@lo:400:kworker.0 00000100:00100000:0.0:1788832130.776492:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832130.776657:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218383232 00000100:00100000:0.0:1788832130.776665:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218383232 00000100:00100000:2.0:1788832130.776668:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218383744 00000100:00100000:2.0:1788832130.776675:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218383744 00000100:00100000:0.0:1788832130.776718:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788832130.776722:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218384256 00000100:00100000:2.0:1788832130.776726:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218384256 00000100:00100000:0.0:1788832130.776730:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218383232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832130.776786:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218383232:12345-0@lo:400:kworker.0 Request processed in 59us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832130.776795:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788832130.776818:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218383616 00000100:00100000:0.0:1788832130.776828:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218383616 00000100:00100000:0.0:1788832130.776847:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218384128 00000100:00100000:0.0:1788832130.776850:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218384128 00000100:00100000:0.0:1788832130.776864:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788832130.776870:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218383744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832130.776902:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218383744:12345-0@lo:400:kworker.0 Request processed in 32us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832130.776909:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788832130.776921:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788832130.776926:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07654a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218384256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832130.776952:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07654a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218384256:12345-0@lo:400:kworker.0 Request processed in 26us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832130.776957:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788832130.776975:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788832130.776989:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218383616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832130.777029:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218383616:12345-0@lo:400:kworker.0 Request processed in 47us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832130.777206:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218383360 00000100:00100000:1.0:1788832130.777211:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218383360 00000100:00100000:1.0:1788832130.777249:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218383872 00000100:00100000:1.0:1788832130.777252:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218383872 00000100:00100000:1.0:1788832130.777267:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218382976 00000100:00100000:1.0:1788832130.777271:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218382976 00000100:00100000:1.0:1788832130.777282:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218383488 00000100:00100000:1.0:1788832130.777285:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218383488 00000100:00100000:1.0:1788832130.777296:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218384000 00000100:00100000:1.0:1788832130.777299:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218384000 00000100:00100000:1.0:1788832130.777310:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218383104 00000100:00100000:1.0:1788832130.777313:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218383104 00000100:00100000:1.0:1788832130.777328:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788832130.777335:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218383360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832130.777372:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218383360:12345-0@lo:400:kworker.0 Request processed in 37us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832130.777386:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788832130.777399:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788832130.777406:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218383872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832130.777433:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218383872:12345-0@lo:400:kworker.0 Request processed in 29us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832130.777439:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788832130.777450:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788832130.777455:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218382976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832130.777481:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218382976:12345-0@lo:400:kworker.0 Request processed in 26us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832130.777486:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788832130.777497:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788832130.777503:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218383488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832130.777528:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218383488:12345-0@lo:400:kworker.0 Request processed in 27us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832130.777535:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788832130.777546:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788832130.777553:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875726218384000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832130.777581:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875726218384000:12345-0@lo:400:kworker.0 Request processed in 30us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832130.777587:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788832130.777599:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788832130.777606:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218383104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832130.777662:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218383104:12345-0@lo:400:kworker.0 Request processed in 56us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832130.777675:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788832130.777696:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b073bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218384384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832130.777729:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832130.777763:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218384384 00000100:00100000:1.0:1788832130.777767:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218384384 00000100:00100000:1.0:1788832130.777794:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788832130.777801:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218384384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788832130.777823:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832130.777859:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218384384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832130.777867:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1788832130.777905:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b073bd500 x1875726218384384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832130.777926:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b073bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218384384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832130.778314:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788832130.778324:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218384128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832130.778362:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218384128:12345-0@lo:400:kworker.0 Request processed in 41us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832130.778369:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788832130.778400:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218382848 00000100:00100000:0.0:1788832130.778404:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218382848 00000100:00100000:0.0:1788832130.778433:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788832130.778441:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3653:x1875726218382848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832130.778472:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3653:x1875726218382848:12345-0@lo:400:kworker.0 Request processed in 33us (2308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832130.778479:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788832130.778674:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b074f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218382848:0@lo:400:kworker.0 00000100:00100000:0.0:1788832130.778700:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218383360:0@lo:400:kworker.0 00000100:00100000:0.0:1788832130.778711:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218383872:0@lo:400:kworker.0 00000100:00100000:0.0:1788832130.778721:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218383232:0@lo:400:kworker.0 00010000:00080000:0.0:1788832130.778733:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0771d500 x1875726218383744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832130.778742:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218383744:0@lo:400:kworker.0 00010000:00080000:0.0:1788832130.778752:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07654380 x1875726218384256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832130.778760:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218384256:0@lo:400:kworker.0 00000100:00080000:0.0:1788832130.782705:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788832130.782715:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788832130.782719:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788832130.782721:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832130.784726:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788832130.785987:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218383104:0@lo:400:kworker.0 00010000:00080000:2.0:1788832130.786011:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0771c700 x1875726218383616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832130.786021:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218383616:0@lo:400:kworker.0 00010000:00080000:2.0:1788832130.786033:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07654e00 x1875726218384128/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832130.786040:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218384128:0@lo:400:kworker.0 00000100:00100000:2.0:1788832130.786052:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218382976:0@lo:400:kworker.0 00010000:00080000:2.0:1788832130.786064:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0771ed80 x1875726218383488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832130.786072:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218383488:0@lo:400:kworker.0 00010000:00080000:2.0:1788832130.786082:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07657b80 x1875726218384000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832130.786099:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218384000:0@lo:400:kworker.0 00000100:00100000:3.0:1788832131.287957:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788832131.288041:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218384512:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788832131.288109:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832131.292709:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218384512 00000100:00100000:0.0:1788832131.292724:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218384512 00000100:00100000:0.0:1788832131.292807:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788832131.292818:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218384512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788832131.292842:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832131.292920:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218384512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (4811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832131.292928:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788832131.293712:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07657b80 x1875726218384512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832131.293734:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218384512:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788832131.553227:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832131.799808:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832131.799842:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218384640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832131.799909:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832131.800021:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218384640 00000100:00100000:3.0:1788832131.800029:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218384640 00000100:00100000:3.0:1788832131.800084:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788832131.800093:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218384640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788832131.800120:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832131.800174:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218384640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832131.800181:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1788832131.800255:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0767ce00 x1875726218384640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832131.800275:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218384640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788832132.313086:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832132.313111:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218384768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788832132.313181:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832132.313463:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218384768 00000100:00100000:3.0:1788832132.313473:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218384768 00000100:00100000:3.0:1788832132.313551:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788832132.313562:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218384768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788832132.313607:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832132.313698:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218384768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832132.313706:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1788832132.313775:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788832132.314300:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0767ca80 x1875726218384768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832132.314328:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218384768:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788832132.566886:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832132.832789:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832132.832839:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832132.832880:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832132.832904:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832132.832921:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832132.832935:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832132.833008:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832132.833290:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202583680 00000100:00100000:0.0:1788832132.833306:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202583680 00000100:00100000:0.0:1788832132.833369:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202583936 00000100:00100000:0.0:1788832132.833373:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202583936 00000100:00100000:0.0:1788832132.833387:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202583808 00000100:00100000:0.0:1788832132.833390:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202583808 00000100:00100000:0.0:1788832132.833400:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202584064 00000100:00100000:0.0:1788832132.833403:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202584064 00000100:00100000:0.0:1788832132.833421:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 139 00000100:00100000:0.0:1788832132.833431:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+6:2395:x1875726202583680:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832132.833517:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+6:2395:x1875726202583680:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 88us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832132.833525:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 139 00000100:00100000:0.0:1788832132.833543:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 140 00000100:00100000:0.0:1788832132.833550:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202583936:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832132.833575:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202583936:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 25us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832132.833581:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 140 00000100:00100000:0.0:1788832132.833593:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 141 00000100:00100000:0.0:1788832132.833599:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202583808:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832132.833656:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202583808:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 22us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832132.833663:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 141 00000100:00100000:0.0:1788832132.833675:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 142 00000100:00100000:0.0:1788832132.833682:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0777b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202584064:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832132.833705:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0777b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202584064:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832132.833718:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 142 00000100:00100000:0.0:1788832132.833743:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202584192 00000100:00100000:0.0:1788832132.833746:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202584192 00000100:00100000:0.0:1788832132.833772:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202584320 00000100:00100000:0.0:1788832132.833775:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202584320 00000100:00100000:0.0:1788832132.833791:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:0.0:1788832132.833797:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202584192:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832132.833834:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07779180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202584192:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 37us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832132.833840:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:0.0:1788832132.833851:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:0.0:1788832132.833856:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202584320:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832132.833893:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202584320:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 35us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832132.833899:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:3.0:1788832132.834325:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202583552 00000100:00100000:3.0:1788832132.834331:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202583552 00000100:00100000:3.0:1788832132.834372:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 303 00000100:00100000:3.0:1788832132.834380:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2395:x1875726202583552:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832132.834417:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2395:x1875726202583552:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 38us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832132.834424:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 303 00000100:00080000:1.0:1788832132.834749:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788832132.834754:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788832132.834757:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788832132.834760:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788832133.590918:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832134.616094:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832134.871049:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832134.871074:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218384896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832134.871144:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832134.872053:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218384896 00000100:00100000:3.0:1788832134.872063:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218384896 00000100:00100000:3.0:1788832134.872124:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788832134.872134:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218384896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788832134.872173:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788832134.872256:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218384896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832134.872264:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788832134.872481:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218384896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832135.383450:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832135.383472:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218385024:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788832135.383542:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832135.383608:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218385024 00000100:00100000:2.0:1788832135.383615:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218385024 00000100:00100000:2.0:1788832135.383681:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788832135.383690:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218385024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788832135.383722:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788832135.383761:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218385024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832135.391737:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788832135.392080:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218385024:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1788832135.519422:0:12508:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788832135.519928:0:12508:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788832135.639866:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832135.894795:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0777ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218385152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832135.894862:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832135.894946:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218385152 00000100:00100000:1.0:1788832135.894954:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218385152 00000100:00100000:1.0:1788832135.895004:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788832135.895014:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0777a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218385152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788832135.895040:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832135.895079:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0777a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218385152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832135.895086:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1788832135.895104:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788832135.895131:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0777ad80 x1875726218385152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832135.895148:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0777ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218385152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832135.897059:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218385536:0@lo:400:kworker.0 00000100:00100000:3.0:1788832135.897121:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832135.897162:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218386048:0@lo:400:kworker.0 00000100:00100000:3.0:1788832135.897186:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832135.897220:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218386560:0@lo:400:kworker.0 00000100:00100000:3.0:1788832135.897252:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832135.897282:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788832135.897288:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218385664:0@lo:400:kworker.0 00000100:00100000:3.0:1788832135.897313:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832135.897422:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218385280:0@lo:400:kworker.0 00000100:00100000:1.0:1788832135.897481:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875726218385408:0@lo:400:kworker.0 00000100:00100000:3.0:1788832135.897520:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218386176:0@lo:400:kworker.0 00000100:00100000:2.0:1788832135.900525:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832135.900588:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218385792:0@lo:400:kworker.0 00000100:00100000:2.0:1788832135.900650:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832135.900671:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218386304:0@lo:400:kworker.0 00000100:00100000:2.0:1788832135.900694:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832135.900815:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218386048 00000100:00100000:2.0:1788832135.900823:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218386048 00000100:00100000:2.0:1788832135.900896:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218386560 00000100:00100000:2.0:1788832135.900900:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218386560 00000100:00100000:2.0:1788832135.900934:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788832135.900943:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218386048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832135.900996:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218386048:12345-0@lo:400:kworker.0 Request processed in 54us (3808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832135.901003:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788832135.901020:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788832135.901026:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218386560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832135.901055:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218386560:12345-0@lo:400:kworker.0 Request processed in 30us (3802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832135.901066:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788832135.901085:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218385280 00000100:00100000:2.0:1788832135.901089:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218385280 00000100:00100000:2.0:1788832135.901112:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788832135.901116:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:3653:x1875726218385280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832135.901141:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:3653:x1875726218385280:12345-0@lo:400:kworker.0 Request processed in 25us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832135.901153:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788832135.901173:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218385536 00000100:00100000:2.0:1788832135.901176:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218385536 00000100:00100000:2.0:1788832135.901215:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218385792 00000100:00100000:2.0:1788832135.901219:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218385792 00000100:00100000:2.0:1788832135.901233:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218386304 00000100:00100000:2.0:1788832135.901236:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218386304 00000100:00100000:2.0:1788832135.901261:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788832135.901268:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218385536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832135.901318:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218385536:12345-0@lo:400:kworker.0 Request processed in 51us (4197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832135.901325:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788832135.901337:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788832135.901353:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218385792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832135.901381:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218385792:12345-0@lo:400:kworker.0 Request processed in 38us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832135.901387:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788832135.901397:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788832135.901403:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218386304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832135.901426:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218386304:12345-0@lo:400:kworker.0 Request processed in 24us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832135.901431:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1788832135.901466:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788832135.901472:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788832135.901474:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832135.901502:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218385280:0@lo:400:kworker.0 00000100:00100000:2.0:1788832135.901528:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218385792:0@lo:400:kworker.0 00000100:00100000:2.0:1788832135.901537:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218386304:0@lo:400:kworker.0 00000100:00100000:2.0:1788832135.901702:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218385664 00000100:00100000:2.0:1788832135.901707:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218385664 00000100:00100000:2.0:1788832135.901753:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788832135.901760:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218385664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832135.901794:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218385664:12345-0@lo:400:kworker.0 Request processed in 37us (4481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832135.901800:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788832135.905099:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832135.905157:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218385920:0@lo:400:kworker.0 00000100:00100000:1.0:1788832135.905207:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832135.905240:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218385408 00000100:00100000:1.0:1788832135.905247:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218385408 00000100:00100000:1.0:1788832135.905295:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218385920 00000100:00100000:1.0:1788832135.905298:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218385920 00000100:00100000:2.0:1788832135.905309:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788832135.905323:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0777ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875726218385408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832135.905349:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788832135.905358:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218385920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832135.905393:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0777ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875726218385408:12345-0@lo:400:kworker.0 Request processed in 74us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832135.905402:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788832135.905406:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218385920:12345-0@lo:400:kworker.0 Request processed in 49us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832135.905414:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1788832135.905429:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788832135.905463:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0767df80 x1875726218385920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832135.905476:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218385920:0@lo:400:kworker.0 00000100:00100000:1.0:1788832135.905483:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218386432:0@lo:400:kworker.0 00000100:00100000:1.0:1788832135.905506:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832135.905549:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875726218385408:0@lo:400:kworker.0 00000100:00100000:2.0:1788832135.905606:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218386432 00000100:00100000:2.0:1788832135.905611:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218386432 00000100:00100000:2.0:1788832135.905855:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788832135.905862:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218386432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832135.905897:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218386432:12345-0@lo:400:kworker.0 Request processed in 35us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832135.905903:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1788832135.905947:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788832135.905969:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0767c000 x1875726218386432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832135.905978:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218386432:0@lo:400:kworker.0 00000100:00100000:3.0:1788832135.912856:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832135.912939:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218385536:0@lo:400:kworker.0 00010000:00080000:3.0:1788832135.912956:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0767ed80 x1875726218386048/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832135.912966:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218386048:0@lo:400:kworker.0 00010000:00080000:3.0:1788832135.912979:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0767d500 x1875726218386560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832135.912987:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218386560:0@lo:400:kworker.0 00000100:00100000:3.0:1788832135.913017:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218385664:0@lo:400:kworker.0 00000100:00100000:1.0:1788832135.913295:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218386176 00000100:00100000:1.0:1788832135.913303:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218386176 00000100:00100000:1.0:1788832135.913387:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788832135.913396:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218386176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832135.913477:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218386176:12345-0@lo:400:kworker.0 Request processed in 82us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832135.913485:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1788832135.913666:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0767e680 x1875726218386176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832135.913676:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218386176:0@lo:400:kworker.0 00000100:00080000:2.0:1788832135.915778:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832136.408091:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218386688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788832136.408158:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832136.408236:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218386688 00000100:00100000:1.0:1788832136.408244:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218386688 00000100:00100000:1.0:1788832136.408312:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788832136.408323:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218386688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788832136.408346:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832136.408403:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218386688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832136.408411:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1788832136.408466:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07654380 x1875726218386688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832136.408492:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218386688:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788832136.664932:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832136.919115:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218386816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788832136.919195:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832136.919374:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218386816 00000100:00100000:3.0:1788832136.919382:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218386816 00000100:00100000:3.0:1788832136.919445:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788832136.919454:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218386816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788832136.919483:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832136.919538:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218386816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832136.919545:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1788832136.919661:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0767e680 x1875726218386816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832136.919678:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218386816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832137.434137:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218386944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832137.434213:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832137.434298:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218386944 00000100:00100000:2.0:1788832137.434306:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218386944 00000100:00100000:2.0:1788832137.434368:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788832137.434377:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218386944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788832137.434397:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788832137.434435:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832137.434438:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218386944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832137.434445:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1788832137.434487:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcb5f80 x1875726218386944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832137.434505:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218386944:0@lo:13:osp-pre-0-0.0 00000020:00000004:0.0:1788832137.454571:0:12605:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788832137.454805:0:12605:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788832137.688645:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832137.942302:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832137.942351:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832137.942389:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832137.942427:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202585088 00000100:00100000:1.0:1788832137.942437:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202585088 00000100:00100000:1.0:1788832137.942504:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:1.0:1788832137.942515:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0777b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2395:x1875726202585088:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832137.942586:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0777b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2395:x1875726202585088:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 74us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832137.942594:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00080000:1.0:1788832137.942615:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832137.942820:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202584576 00000100:00100000:2.0:1788832137.942824:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202584576 00000100:00100000:2.0:1788832137.942867:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202584832 00000100:00100000:2.0:1788832137.942870:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202584832 00000100:00100000:2.0:1788832137.942891:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 149 00000100:00100000:2.0:1788832137.942898:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+6:2395:x1875726202584576:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832137.942937:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+6:2395:x1875726202584576:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 39us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832137.942944:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 149 00000100:00100000:2.0:1788832137.942958:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 150 00000100:00100000:2.0:1788832137.942975:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0777bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2395:x1875726202584832:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832137.943001:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0777bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2395:x1875726202584832:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 36us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832137.943020:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 150 00000100:00080000:1.0:1788832137.943481:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832137.950082:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832137.950156:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832137.950214:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832137.950241:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832137.950268:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202584704 00000100:00100000:0.0:1788832137.950276:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202584704 00000100:00100000:0.0:1788832137.950341:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202584960 00000100:00100000:0.0:1788832137.950345:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202584960 00000100:00100000:0.0:1788832137.950371:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 151 00000100:00100000:0.0:1788832137.950380:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202584704:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832137.950454:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202584704:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 76us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832137.950461:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 151 00000100:00100000:0.0:1788832137.950477:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 152 00000100:00100000:0.0:1788832137.950483:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202584960:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832137.950508:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202584960:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 26us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832137.950514:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 152 00000100:00100000:0.0:1788832137.950530:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202585216 00000100:00100000:0.0:1788832137.950533:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202585216 00000100:00100000:0.0:1788832137.950559:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:0.0:1788832137.950566:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202585216:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832137.950592:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202585216:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832137.950598:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00080000:0.0:1788832137.950659:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788832137.950664:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788832137.956490:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202584448 00000100:00100000:2.0:1788832137.956504:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202584448 00000100:00100000:0.0:1788832137.956648:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 305 00000100:00100000:0.0:1788832137.956673:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2396:x1875726202584448:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832137.956752:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2396:x1875726202584448:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 81us (6677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832137.956760:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 305 00010000:00010000:1.0:1788832138.710840:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832139.739292:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788832139.754773:0:12703:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788832139.755278:0:12703:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788832139.992559:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218387072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788832139.992691:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832139.993307:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218387072 00000100:00100000:0.0:1788832139.993316:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218387072 00000100:00100000:3.0:1788832139.993477:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788832139.993488:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218387072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788832139.993522:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788832139.993597:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218387072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832139.993604:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788832139.993740:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218387072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832140.503960:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832140.503982:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218387200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788832140.504054:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832140.504119:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218387200 00000100:00100000:2.0:1788832140.504126:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218387200 00000100:00100000:2.0:1788832140.504183:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788832140.504192:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c09262050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218387200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788832140.504224:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788832140.504270:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c09262050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218387200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832140.504278:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788832140.504371:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218387200:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788832140.761410:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832141.016807:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218387328:0@lo:400:kworker.0 00000100:00100000:1.0:1788832141.016820:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218387712:0@lo:400:kworker.0 00000100:00100000:2.0:1788832141.016925:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0777aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875726218387456:0@lo:400:kworker.0 00000100:00100000:3.0:1788832141.016997:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0777b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218387584:0@lo:400:kworker.0 00000100:00100000:1.0:1788832141.022870:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832141.022947:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218388224:0@lo:400:kworker.0 00000100:00100000:1.0:1788832141.022990:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832141.023017:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218388736:0@lo:400:kworker.0 00000100:00100000:1.0:1788832141.023043:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832141.023091:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218387712 00000100:00100000:1.0:1788832141.023097:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218387712 00000100:00100000:1.0:1788832141.023144:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788832141.023152:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218387712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832141.023220:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218387712:12345-0@lo:400:kworker.0 Request processed in 68us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832141.023227:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788832141.023251:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218388224 00000100:00100000:1.0:1788832141.023254:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218388224 00000100:00100000:1.0:1788832141.023288:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218388736 00000100:00100000:1.0:1788832141.023291:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218388736 00000100:00100000:1.0:1788832141.023309:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788832141.023315:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218388224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832141.023357:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218388224:12345-0@lo:400:kworker.0 Request processed in 43us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832141.023363:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788832141.023373:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788832141.023378:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218388736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832141.023514:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218388736:12345-0@lo:400:kworker.0 Request processed in 25us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832141.023522:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1788832141.023559:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788832141.023563:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832141.023600:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218387712:0@lo:400:kworker.0 00010000:00080000:1.0:1788832141.023613:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f7800 x1875726218388224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832141.023651:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218388224:0@lo:400:kworker.0 00010000:00080000:1.0:1788832141.023663:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c18fe6680 x1875726218388736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832141.023671:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218388736:0@lo:400:kworker.0 00000100:00100000:2.0:1788832141.023810:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832141.023844:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0777a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218387968:0@lo:400:kworker.0 00000100:00100000:2.0:1788832141.023866:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832141.023891:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1875726218388480:0@lo:400:kworker.0 00000100:00100000:2.0:1788832141.023912:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832141.023945:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218388992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832141.023970:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832141.023988:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788832141.023993:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218388864:0@lo:400:kworker.0 00000100:00100000:2.0:1788832141.024012:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832141.024048:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218388992 00000100:00100000:2.0:1788832141.024051:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218388992 00000100:00100000:2.0:1788832141.024084:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788832141.024090:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218388992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788832141.024113:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788832141.024147:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218388992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832141.024163:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788832141.024182:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218388864 00000100:00100000:2.0:1788832141.024185:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218388864 00000100:00100000:2.0:1788832141.024206:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788832141.024212:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218388864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832141.024239:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218388864:12345-0@lo:400:kworker.0 Request processed in 28us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832141.024245:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1788832141.024260:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788832141.024348:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218387456 00000100:00100000:2.0:1788832141.024352:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218387456 00000100:00100000:2.0:1788832141.024380:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218387968 00000100:00100000:2.0:1788832141.024382:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218387968 00000100:00100000:2.0:1788832141.024397:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218388480 00000100:00100000:2.0:1788832141.024400:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218388480 00000100:00100000:2.0:1788832141.025681:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788832141.025695:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875726218387456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832141.025766:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875726218387456:12345-0@lo:400:kworker.0 Request processed in 76us (1956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832141.026614:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832141.026691:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218387840:0@lo:400:kworker.0 00000100:00100000:0.0:1788832141.026759:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832141.026780:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218388352:0@lo:400:kworker.0 00000100:00100000:0.0:1788832141.026804:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832141.026868:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218388352 00000100:00100000:0.0:1788832141.026875:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218388352 00000100:00100000:0.0:1788832141.026928:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788832141.026938:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218388352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832141.026989:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218388352:12345-0@lo:400:kworker.0 Request processed in 53us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832141.026996:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1788832141.027035:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f4a80 x1875726218388352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832141.027048:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218388352:0@lo:400:kworker.0 00000100:00100000:3.0:1788832141.029189:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832141.029247:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218388096:0@lo:400:kworker.0 00000100:00100000:3.0:1788832141.029296:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832141.029310:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218388608:0@lo:400:kworker.0 00000100:00100000:3.0:1788832141.029330:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832141.029876:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788832141.029893:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218387968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832141.030340:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218387968:12345-0@lo:400:kworker.0 Request processed in 453us (6470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832141.030349:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788832141.030377:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218388096 00000100:00100000:1.0:1788832141.030383:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218388096 00000100:00100000:1.0:1788832141.030412:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218388608 00000100:00100000:1.0:1788832141.030416:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218388608 00000100:00100000:1.0:1788832141.030432:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788832141.030439:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875726218388480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832141.030467:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875726218388480:12345-0@lo:400:kworker.0 Request processed in 30us (6555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832141.030471:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788832141.030480:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788832141.030484:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218388096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832141.030522:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218388096:12345-0@lo:400:kworker.0 Request processed in 37us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832141.030529:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788832141.030542:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788832141.030548:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875726218388608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832141.030574:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875726218388608:12345-0@lo:400:kworker.0 Request processed in 26us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832141.030580:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:1.0:1788832141.031438:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788832141.031445:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788832141.031448:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788832141.031841:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f5f80 x1875726218388608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832141.031869:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218388608:0@lo:400:kworker.0 00000100:00100000:2.0:1788832141.031929:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788832141.031967:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218387328 00000100:00100000:2.0:1788832141.031979:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218387328 00010000:00080000:0.0:1788832141.031990:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c18fe4380 x1875726218388864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832141.032012:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218388864:0@lo:400:kworker.0 00010000:00080000:0.0:1788832141.032029:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0767d500 x1875726218388992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832141.032032:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788832141.032045:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3653:x1875726218387328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832141.032053:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218388992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832141.032070:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0777aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875726218387456:0@lo:400:kworker.0 00000100:00100000:0.0:1788832141.032081:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0777a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218387968:0@lo:400:kworker.0 00000100:00100000:0.0:1788832141.032094:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1875726218388480:0@lo:400:kworker.0 00000100:00100000:2.0:1788832141.032111:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3653:x1875726218387328:12345-0@lo:400:kworker.0 Request processed in 67us (5498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832141.032120:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788832141.032173:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218387328:0@lo:400:kworker.0 00000100:00100000:2.0:1788832141.032203:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218387840 00000100:00100000:2.0:1788832141.032207:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218387840 00000100:00100000:2.0:1788832141.032229:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218387584 00000100:00100000:2.0:1788832141.032232:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218387584 00000100:00100000:2.0:1788832141.032243:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788832141.032249:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218387840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832141.032287:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218387840:12345-0@lo:400:kworker.0 Request processed in 37us (5527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832141.032294:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788832141.032305:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788832141.032310:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218387584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832141.032341:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218387584:12345-0@lo:400:kworker.0 Request processed in 30us (3157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832141.032349:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788832141.032379:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218387840:0@lo:400:kworker.0 00000100:00100000:3.0:1788832141.032560:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0777b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218387584:0@lo:400:kworker.0 00010000:00080000:3.0:1788832141.032572:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f4000 x1875726218388096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832141.032582:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218388096:0@lo:400:kworker.0 00000100:00100000:3.0:1788832141.529021:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218389120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788832141.529136:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832141.529259:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218389120 00000100:00100000:1.0:1788832141.529267:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218389120 00000100:00100000:1.0:1788832141.529328:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788832141.529338:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218389120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788832141.529362:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832141.532604:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218389120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3258us (3457us total) trans 0 rc 0/0 00010000:00080000:3.0:1788832141.532841:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07655f80 x1875726218389120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832141.532866:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218389120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788832141.532920:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000020:00000004:1.0:1788832141.775044:0:12800:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788832141.775312:0:12800:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788832141.787751:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832142.043415:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788832142.046315:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218389248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832142.046696:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832142.046824:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218389248 00000100:00100000:1.0:1788832142.046832:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218389248 00000100:00100000:1.0:1788832142.046893:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788832142.046903:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218389248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788832142.046945:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832142.046988:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218389248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832142.046994:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1788832142.047233:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0767c380 x1875726218389248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832142.047510:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218389248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788832142.553579:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788832142.553604:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218389376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788832142.553701:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832142.553973:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218389376 00000100:00100000:1.0:1788832142.553980:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218389376 00000100:00100000:1.0:1788832142.554033:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788832142.554043:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218389376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832142.554063:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832142.554115:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218389376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832142.554123:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1788832142.554306:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0767f480 x1875726218389376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832142.554325:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218389376:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788832142.807230:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832143.067250:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832143.070555:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832143.070586:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832143.070613:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832143.070652:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832143.070672:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832143.070751:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832143.070784:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202585984 00000100:00100000:0.0:1788832143.070806:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202585984 00000100:00100000:0.0:1788832143.070859:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202586112 00000100:00100000:0.0:1788832143.070862:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202586112 00000100:00100000:0.0:1788832143.070887:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:0.0:1788832143.070897:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2392:x1875726202585984:12345-192.168.203.26@tcp:9:kworker.0 00000020:00000080:0.0:1788832143.071000:0:10097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b2835370b9 00000100:00080000:0.0:1788832143.071010:0:10097:0:(import.c:65:import_set_state_nolock()) ffff9d2b073a2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788832143.071055:0:10097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788832143.071210:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+2:2392:x1875726202585984:12345-192.168.203.26@tcp:9:kworker.0 Request processed in 315us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832143.071218:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:0.0:1788832143.071235:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:0.0:1788832143.071242:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2392:x1875726202586112:12345-192.168.203.26@tcp:9:kworker.0 00000100:00100000:3.0:1788832143.071505:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202585600 00000100:00100000:3.0:1788832143.071511:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202585600 00000100:00100000:3.0:1788832143.071537:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202585856 00000100:00100000:3.0:1788832143.071539:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202585856 00000100:00100000:3.0:1788832143.071552:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202585472 00000100:00100000:3.0:1788832143.071554:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202585472 00000100:00100000:3.0:1788832143.071566:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202585728 00000100:00100000:3.0:1788832143.071568:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202585728 00000100:00100000:3.0:1788832143.071580:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 159 00000100:00100000:3.0:1788832143.071587:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2394:x1875726202585600:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832143.071638:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2394:x1875726202585600:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 34us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832143.071644:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 159 00000100:00100000:3.0:1788832143.071670:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 160 00000100:00100000:3.0:1788832143.071676:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2394:x1875726202585856:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832143.071703:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2394:x1875726202585856:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 26us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832143.071708:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 160 00000100:00100000:3.0:1788832143.071720:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 161 00000100:00100000:3.0:1788832143.071726:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202585472:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832143.071748:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202585472:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 23us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832143.071754:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 161 00000100:00100000:3.0:1788832143.071764:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 162 00000100:00100000:3.0:1788832143.071770:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202585728:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832143.071792:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202585728:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 23us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832143.071798:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 162 00000020:00000080:0.0:1788832143.071874:0:10097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b2835370c0 00000100:00080000:0.0:1788832143.071882:0:10097:0:(import.c:65:import_set_state_nolock()) ffff9d2b076ec800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788832143.071997:0:10097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788832143.072088:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+2:2392:x1875726202586112:12345-192.168.203.26@tcp:9:kworker.0 Request processed in 846us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832143.072095:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00010000:00010000:0.0:1788832143.072133:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832143.072426:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202585344 00000100:00100000:1.0:1788832143.072432:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202585344 00000100:00100000:1.0:1788832143.072468:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 307 00000100:00100000:1.0:1788832143.072476:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2394:x1875726202585344:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832143.072505:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2394:x1875726202585344:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 30us (5263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832143.072511:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 307 00000100:00080000:1.0:1788832143.072544:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788832143.072549:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788832143.072552:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788832143.072554:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788832143.076068:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788832143.737597:0:12897:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788832143.737864:0:12897:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788832143.831940:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832144.854932:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832145.111436:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218389504:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788832145.111516:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832145.112286:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218389504 00000100:00100000:0.0:1788832145.112297:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218389504 00000100:00100000:0.0:1788832145.112361:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788832145.112373:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218389504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788832145.112419:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788832145.112492:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218389504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832145.112516:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788832145.112822:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218389504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832145.622854:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218389632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788832145.622942:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832145.623186:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218389632 00000100:00100000:0.0:1788832145.623194:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218389632 00000100:00100000:0.0:1788832145.623252:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788832145.623262:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218389632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788832145.623299:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788832145.623359:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218389632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832145.623367:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788832145.623828:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218389632:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788832145.880612:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832146.135459:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832146.135483:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218389760:0@lo:400:kworker.0 00000100:00100000:3.0:1788832146.135507:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218389888:0@lo:400:kworker.0 00000100:00100000:0.0:1788832146.135649:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218390272:0@lo:400:kworker.0 00000100:00100000:1.0:1788832146.135707:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218390016:0@lo:400:kworker.0 00000100:00100000:3.0:1788832146.137287:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832146.137382:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218390400:0@lo:400:kworker.0 00000100:00100000:3.0:1788832146.137429:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832146.137457:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218390912:0@lo:400:kworker.0 00000100:00100000:3.0:1788832146.137514:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832146.137561:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218389888 00000100:00100000:3.0:1788832146.137568:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218389888 00000100:00100000:3.0:1788832146.137612:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218390400 00000100:00100000:3.0:1788832146.137616:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218390400 00000100:00100000:3.0:1788832146.137671:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218390912 00000100:00100000:3.0:1788832146.137677:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218390912 00000100:00100000:3.0:1788832146.137699:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788832146.137710:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218389888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832146.137776:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218389888:12345-0@lo:400:kworker.0 Request processed in 66us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832146.137783:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788832146.137799:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788832146.137805:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218390400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832146.137834:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218390400:12345-0@lo:400:kworker.0 Request processed in 29us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832146.137840:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788832146.137856:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788832146.137863:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218390912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832146.137893:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218390912:12345-0@lo:400:kworker.0 Request processed in 31us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832146.137899:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:3.0:1788832146.137919:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832146.137947:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218390400:0@lo:400:kworker.0 00000100:00100000:3.0:1788832146.137961:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218390912:0@lo:400:kworker.0 00000100:00100000:3.0:1788832146.137968:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218389888:0@lo:400:kworker.0 00000100:00100000:3.0:1788832146.138058:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218391424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832146.138084:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832146.138580:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218391424 00000100:00100000:3.0:1788832146.138587:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218391424 00000100:00100000:3.0:1788832146.138669:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788832146.138682:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218391424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788832146.138709:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832146.138761:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218391424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832146.138767:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1788832146.138786:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788832146.138805:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0767f480 x1875726218391424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832146.138822:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218391424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832146.140516:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832146.140609:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218390144:0@lo:400:kworker.0 00000100:00100000:2.0:1788832146.140693:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832146.140720:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218390656:0@lo:400:kworker.0 00000100:00100000:2.0:1788832146.140747:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832146.140768:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0777a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218391168:0@lo:400:kworker.0 00000100:00100000:2.0:1788832146.140791:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832146.140812:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788832146.140819:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218390784:0@lo:400:kworker.0 00000100:00100000:2.0:1788832146.140840:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832146.140858:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0777b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218391296:0@lo:400:kworker.0 00000100:00100000:2.0:1788832146.140881:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832146.140925:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218390656 00000100:00100000:3.0:1788832146.140930:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218389760 00000100:00100000:2.0:1788832146.140932:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218390656 00000100:00100000:3.0:1788832146.140938:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218389760 00000100:00100000:2.0:1788832146.140988:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218391168 00000100:00100000:3.0:1788832146.140993:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788832146.140994:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218391168 00000100:00100000:3.0:1788832146.141003:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218389760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832146.141018:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218390784 00000100:00100000:2.0:1788832146.141035:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218390784 00000100:00100000:3.0:1788832146.141062:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218389760:12345-0@lo:400:kworker.0 Request processed in 61us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832146.141069:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788832146.142019:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218391296 00000100:00100000:3.0:1788832146.142029:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218391296 00000100:00100000:3.0:1788832146.142065:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788832146.142074:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218390656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832146.142182:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788832146.142191:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218391168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832146.142236:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218390656:12345-0@lo:400:kworker.0 Request processed in 161us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832146.142256:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788832146.142264:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832146.142276:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788832146.142286:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218391296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832146.142320:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218391168:12345-0@lo:400:kworker.0 Request processed in 129us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832146.142326:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218390272 00000100:00100000:3.0:1788832146.142333:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218391296:12345-0@lo:400:kworker.0 Request processed in 46us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832146.142333:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788832146.142334:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218390272 00000100:00100000:3.0:1788832146.142344:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788832146.142356:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788832146.142367:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218390784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832146.142380:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788832146.142392:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218390272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832146.142400:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218390144 00000100:00100000:2.0:1788832146.142406:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218390784:12345-0@lo:400:kworker.0 Request processed in 40us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832146.142408:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218390144 00000100:00100000:2.0:1788832146.142415:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788832146.142445:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788832146.142450:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788832146.142455:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788832146.142460:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218390272:12345-0@lo:400:kworker.0 Request processed in 69us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832146.142469:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218390144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832146.142473:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:2.0:1788832146.142490:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f6300 x1875726218390784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832146.142507:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218390784:0@lo:400:kworker.0 00000100:00100000:0.0:1788832146.142519:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218390272:0@lo:400:kworker.0 00010000:00080000:2.0:1788832146.142523:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0777b800 x1875726218391296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832146.142534:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0777b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218391296:0@lo:400:kworker.0 00000100:00100000:1.0:1788832146.142645:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832146.142669:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218390528:0@lo:400:kworker.0 00000100:00100000:1.0:1788832146.142695:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832146.142711:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218391040:0@lo:400:kworker.0 00000100:00100000:1.0:1788832146.142728:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832146.142752:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218390528 00000100:00100000:2.0:1788832146.143423:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218391040 00000100:00100000:2.0:1788832146.143431:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218391040 00000100:00100000:2.0:1788832146.143472:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788832146.143480:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0777a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218391040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832146.143526:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0777a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218391040:12345-0@lo:400:kworker.0 Request processed in 47us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832146.143532:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:2.0:1788832146.143562:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788832146.144610:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218390016 00000100:00100000:0.0:1788832146.144652:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218390016 00000100:00100000:0.0:1788832146.144697:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788832146.144706:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218390016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832146.144769:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218390016:12345-0@lo:400:kworker.0 Request processed in 65us (2148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832146.144789:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:0.0:1788832146.144851:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f7800 x1875726218391040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832146.144864:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218391040:0@lo:400:kworker.0 00000100:00100000:0.0:1788832146.144894:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218390016:0@lo:400:kworker.0 00000100:00100000:3.0:1788832146.146689:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218390144:12345-0@lo:400:kworker.0 Request processed in 4216us (5987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832146.146701:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788832146.146860:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218390144:0@lo:400:kworker.0 00010000:00080000:0.0:1788832146.146878:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f5f80 x1875726218390656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832146.146889:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218390656:0@lo:400:kworker.0 00010000:00080000:0.0:1788832146.146904:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0777a680 x1875726218391168/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832146.146912:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0777a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218391168:0@lo:400:kworker.0 00000100:00100000:0.0:1788832146.146924:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218389760:0@lo:400:kworker.0 00000100:00100000:1.0:1788832146.147409:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218390528 00000100:00100000:1.0:1788832146.147491:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788832146.147501:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218390528:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788832146.147509:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788832146.147581:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218390528:12345-0@lo:400:kworker.0 Request processed in 82us (4883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832146.147588:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00010000:00080000:0.0:1788832146.147607:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f4000 x1875726218390528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832146.147649:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218390528:0@lo:400:kworker.0 00000100:00100000:1.0:1788832146.652162:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218391552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788832146.652233:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832146.652312:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218391552 00000100:00100000:0.0:1788832146.652321:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218391552 00000100:00100000:0.0:1788832146.652376:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788832146.652386:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0777aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218391552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788832146.652409:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832146.652474:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0777aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218391552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832146.652482:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1788832146.652521:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0771c700 x1875726218391552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832146.652540:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218391552:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788832146.903452:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832147.158835:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218391680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788832147.158910:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832147.164025:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218391680 00000100:00100000:1.0:1788832147.164043:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218391680 00000100:00100000:1.0:1788832147.164123:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788832147.164136:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218391680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788832147.164171:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832147.166792:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218391680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2652us (7883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832147.166805:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1788832147.167183:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c182a8e00 x1875726218391680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832147.167206:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218391680:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1788832147.194518:0:13042:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788832147.671549:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788832147.671573:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218391808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788832147.671655:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832147.673776:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218391808 00000100:00100000:3.0:1788832147.673789:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218391808 00000100:00100000:3.0:1788832147.674098:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788832147.674120:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218391808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788832147.674147:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832147.674233:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218391808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (2576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832147.674241:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1788832147.674319:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0767f480 x1875726218391808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832147.674339:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218391808:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788832147.928881:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832148.184999:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832148.185043:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832148.185071:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832148.185089:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832148.185130:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832148.185157:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202586496 00000100:00100000:0.0:1788832148.185165:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202586496 00000100:00100000:0.0:1788832148.185213:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202586752 00000100:00100000:0.0:1788832148.185229:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202586752 00000100:00100000:0.0:1788832148.185245:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202586368 00000100:00100000:0.0:1788832148.185247:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202586368 00000100:00100000:0.0:1788832148.185256:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202586624 00000100:00100000:0.0:1788832148.185258:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202586624 00000100:00100000:0.0:1788832148.185273:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 169 00000100:00100000:0.0:1788832148.185281:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202586496:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832148.185348:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202586496:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 68us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832148.185355:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 169 00000100:00100000:0.0:1788832148.185370:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 170 00000100:00100000:0.0:1788832148.185375:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202586752:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832148.185395:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202586752:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 21us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832148.185400:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 170 00000100:00100000:0.0:1788832148.185410:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 171 00000100:00100000:0.0:1788832148.185415:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202586368:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832148.185433:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202586368:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 18us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832148.185438:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 171 00000100:00100000:0.0:1788832148.185460:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 172 00000100:00100000:0.0:1788832148.185466:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202586624:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832148.185485:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202586624:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 20us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832148.185490:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 172 00000100:00080000:0.0:1788832148.185517:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788832148.185520:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788832148.186037:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202586240 00000100:00100000:3.0:1788832148.186043:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202586240 00000100:00100000:3.0:1788832148.186088:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 309 00000100:00100000:3.0:1788832148.186103:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2393:x1875726202586240:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832148.186159:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2393:x1875726202586240:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 64us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832148.186165:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 309 00000001:00100000:1.0:1788832148.699962:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c5983f70-61a6-4df8-ba8a-04bd100176c7 00000020:00000080:1.0:1788832148.699972:0:8434:0:(genops.c:885:class_export_put()) final put ffff9d2b073a0800/c5983f70-61a6-4df8-ba8a-04bd100176c7 00000020:00000080:0.0:1788832148.700927:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b073a0800/c5983f70-61a6-4df8-ba8a-04bd100176c7 for lustre-OST0000 00000020:00000080:0.0:1788832148.700995:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2b073a2000 for lustre-OST0000 00000001:00100000:3.0:1788832148.702225:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c5983f70-61a6-4df8-ba8a-04bd100176c7 00000020:00000080:3.0:1788832148.702232:0:9518:0:(genops.c:885:class_export_put()) final put ffff9d2c3fc35000/c5983f70-61a6-4df8-ba8a-04bd100176c7 00000020:00000080:1.0:1788832148.702442:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3fc35000/c5983f70-61a6-4df8-ba8a-04bd100176c7 for lustre-OST0001 00000020:00000080:1.0:1788832148.702470:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2b076ec800 for lustre-OST0001 00010000:00010000:2.0:1788832148.950964:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832149.975997:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832150.235125:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b074f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218391936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788832150.235193:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832150.235265:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218391936 00000100:00100000:0.0:1788832150.235272:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218391936 00000100:00100000:0.0:1788832150.235315:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788832150.235323:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218391936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788832150.235356:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788832150.235413:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218391936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832150.235420:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788832150.235465:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b074f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218391936:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1788832150.392707:0:13189:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe48c4ac70 20000000:00000080:2.0:1788832150.392723:0:13189:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d2b075ff000 uarg=0000000000000000 20000000:01000000:2.0:1788832150.393188:0:13189:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788832150.393195:0:13189:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788832150.393199:0:13189:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788832150.393950:0:13190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788832150.394088:0:13189:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788832150.412975:0:13189:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788832150.413981:0:13189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d2c00031000/0x998c12b2835370c7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832150.414003:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c092dc200/0x998c12b28353705e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283537057 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832150.414011:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c092ddc00/0x998c12b28353706c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283537065 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832150.414018:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c092dc400/0x998c12b28353707a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283537073 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832150.414024:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c092dca00/0x998c12b283537088 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283537081 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832150.414034:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c36db8400/0x998c12b28353708f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04568 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832150.414042:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c390f2400/0x998c12b2835370a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045a7 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832150.414049:0:13189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d2c00031000/0x998c12b2835370c7 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832150.414117:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c390f2400/0x998c12b2835370a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045a7 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832150.414132:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2c390f2400/0x998c12b2835370a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045a7 expref: 12 pid: 6518 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832150.414147:0:13189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875726218392064:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832150.414251:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c36db8400/0x998c12b28353708f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04568 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832150.414261:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2c36db8400/0x998c12b28353708f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04568 expref: 12 pid: 6519 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832150.414270:0:13189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875726218392192:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832150.414304:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c092dca00/0x998c12b283537088 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283537081 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832150.414312:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c092dca00/0x998c12b283537088 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283537081 expref: 23 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832150.414321:0:13189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875726218392320:0@lo:104: 00000100:00100000:2.0:1788832150.414357:0:13189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788832150.414411:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c092dc400/0x998c12b28353707a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283537073 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832150.414419:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c092dc400/0x998c12b28353707a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283537073 expref: 23 pid: 6518 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832150.414438:0:13189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182a8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875726218392448:0@lo:104: 00000100:00100000:2.0:1788832150.414463:0:13189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788832150.414490:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c092ddc00/0x998c12b28353706c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283537065 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832150.414495:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218392320 00010000:00010000:2.0:1788832150.414499:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c092ddc00/0x998c12b28353706c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283537065 expref: 23 pid: 6519 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832150.414505:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218392320 00000100:00100000:2.0:1788832150.414510:0:13189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182a9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875726218392576:0@lo:104: 00000100:00100000:2.0:1788832150.414537:0:13189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788832150.414556:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c092dc200/0x998c12b28353705e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283537057 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832150.414564:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c092dc200/0x998c12b28353705e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283537057 expref: 23 pid: 6519 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832150.414572:0:13189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06611180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875726218392704:0@lo:104: 00000100:00100000:1.0:1788832150.414590:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218392448 00000100:00100000:1.0:1788832150.414595:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218392448 00000100:00100000:2.0:1788832150.414596:0:13189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832150.414609:0:13189:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b0720d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788832150.414612:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218392576 00000100:00100000:1.0:1788832150.414616:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218392576 00000100:00100000:1.0:1788832150.414670:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218392704 00000100:00100000:1.0:1788832150.414674:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218392704 00000100:00100000:1.0:1788832150.414997:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788832150.415010:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+6:13189:x1875726218392320:12345-0@lo:104: 00010000:00010000:1.0:1788832150.415022:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283537081 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283537088 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832150.415085:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788832150.415099:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+6:13189:x1875726218392320:12345-0@lo:104: Request processed in 85us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832150.416470:0:13189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875726218392320:0@lo:104: 00010000:00010000:0.0:1788832150.419209:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832150.419225:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283537081 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283537088 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.419237:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc600 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:0.0:1788832150.419241:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283537081 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283537088 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.419251:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283537081 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283537088 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832150.419277:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283537081 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283537088 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832150.419283:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788832150.419336:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283537081 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283537088 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.419344:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832150.420471:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283537081 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283537088 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.420484:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc600/0x998c12b283537081 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283537088 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.420502:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832150.420504:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832150.420506:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832150.420519:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788832150.420539:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b074f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218392832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788832150.420606:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832150.420679:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218392832 00000100:00100000:0.0:1788832150.420687:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218392832 00010000:00010000:0.0:1788832150.420718:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c092dca00/0x998c12b283537088 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283537081 expref: 24 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832150.420756:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788832150.420765:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e55f0905-9d39-4464-9830-326b420fb582+24:3653:x1875726218392832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832150.420779:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832150.420795:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c092dca00/0x998c12b283537088 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283537081 expref: 24 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.420806:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c092dca00/0x998c12b283537088 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283537081 expref: 24 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.420823:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c092dca00/0x998c12b283537088 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283537081 expref: 24 pid: 6517 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.420836:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832150.420872:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e55f0905-9d39-4464-9830-326b420fb582+23:3653:x1875726218392832:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832150.420879:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788832150.420917:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b074f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218392832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788832150.421857:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832150.421891:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832150.422077:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788832150.422120:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202586880 00000100:00100000:1.0:1788832150.422126:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202586880 00010000:00010000:1.0:1788832150.422150:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c390f2400/0x998c12b2835370a4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045a7 expref: 13 pid: 6518 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832150.422184:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202587008 00000100:00100000:1.0:1788832150.422188:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202587008 00010000:00010000:1.0:1788832150.422200:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c36db8400/0x998c12b28353708f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04568 expref: 14 pid: 6519 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832150.422218:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:1.0:1788832150.422226:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:229a6744-cc0e-4765-812a-1d39bc7df2da+14:2394:x1875726202586880:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832150.422238:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832150.422254:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c390f2400/0x998c12b2835370a4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045a7 expref: 14 pid: 6518 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832150.422265:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c390f2400/0x998c12b2835370a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045a7 expref: 14 pid: 6518 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832150.422280:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832150.422324:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:229a6744-cc0e-4765-812a-1d39bc7df2da+14:2394:x1875726202586880:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 98us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832150.422331:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:1.0:1788832150.422345:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:1.0:1788832150.422352:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2394:x1875726202587008:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832150.422362:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832150.422366:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c36db8400/0x998c12b28353708f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04568 expref: 13 pid: 6519 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832150.422375:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c36db8400/0x998c12b28353708f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04568 expref: 13 pid: 6519 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832150.422384:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832150.422400:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2394:x1875726202587008:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 49us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832150.422406:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:1.0:1788832150.423528:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788832150.423545:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+5:13189:x1875726218392448:12345-0@lo:104: 00010000:00010000:2.0:1788832150.423548:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c390f2400/0x998c12b2835370a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045a7 expref: 12 pid: 6518 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832150.423561:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd200/0x998c12b283537073 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b28353707a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832150.423569:0:13189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875726218392064:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832150.423586:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c36db8400/0x998c12b28353708f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04568 expref: 11 pid: 6519 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832150.423610:0:13189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875726218392192:192.168.203.26@tcp:104: 00010000:00010000:1.0:1788832150.423670:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788832150.423677:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+5:13189:x1875726218392448:12345-0@lo:104: Request processed in 140us (9214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832150.423685:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788832150.423705:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788832150.423712:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+4:13189:x1875726218392576:12345-0@lo:104: 00010000:00010000:1.0:1788832150.423720:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c092dda00/0x998c12b283537065 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b28353706c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832150.423772:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788832150.423778:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+4:13189:x1875726218392576:12345-0@lo:104: Request processed in 67us (9240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832150.423786:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788832150.423794:0:13189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182a8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875726218392448:0@lo:104: 00000100:00100000:2.0:1788832150.423806:0:13189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182a9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875726218392576:0@lo:104: 00010000:00010000:0.0:1788832150.423948:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788832150.423956:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd200/0x998c12b283537073 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b28353707a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.423965:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dd200 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:0.0:1788832150.423969:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd200/0x998c12b283537073 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b28353707a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.423977:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd200/0x998c12b283537073 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b28353707a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832150.423983:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd200/0x998c12b283537073 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b28353707a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832150.424000:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788832150.425000:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd200/0x998c12b283537073 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353707a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.425013:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832150.425049:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd200/0x998c12b283537073 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353707a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.425056:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c092dd200/0x998c12b283537073 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353707a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.425071:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832150.425076:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c092dda00/0x998c12b283537065 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b28353706c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.425082:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dda00 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:0.0:1788832150.425085:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dda00/0x998c12b283537065 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b28353706c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.425103:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c092dda00/0x998c12b283537065 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b28353706c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832150.425109:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dda00/0x998c12b283537065 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b28353706c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832150.425114:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788832150.425843:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b074f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218392960:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788832150.425889:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832150.425910:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788832150.425911:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832150.425927:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06613100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+3:13189:x1875726218392704:12345-0@lo:104: 00010000:00010000:1.0:1788832150.425938:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b283537057 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b28353705e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832150.425991:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218392960 00000100:00100000:3.0:1788832150.426000:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218392960 00010000:00010000:1.0:1788832150.426000:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788832150.426009:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06613100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+3:13189:x1875726218392704:12345-0@lo:104: Request processed in 89us (11413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832150.426017:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1788832150.426029:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c092dc400/0x998c12b28353707a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283537073 expref: 23 pid: 6518 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832150.426034:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788832150.426060:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788832150.426069:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e55f0905-9d39-4464-9830-326b420fb582+23:3651:x1875726218392960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788832150.426081:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832150.426087:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c092dc400/0x998c12b28353707a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283537073 expref: 23 pid: 6518 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832150.426109:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c092dc400/0x998c12b28353707a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283537073 expref: 23 pid: 6518 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832150.426125:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c092dc400/0x998c12b28353707a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283537073 expref: 23 pid: 6518 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832150.426139:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832150.426173:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e55f0905-9d39-4464-9830-326b420fb582+22:3651:x1875726218392960:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (265us total) trans 0 rc 0/0 00010000:00010000:1.0:1788832150.426193:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832150.426197:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:1.0:1788832150.426200:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b283537057 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b28353705e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832150.426217:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d3400 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:1.0:1788832150.426221:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b283537057 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b28353705e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832150.426230:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b283537057 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b28353705e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788832150.426238:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b283537057 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b28353705e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832150.426245:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b074f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218392960:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1788832150.426246:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788832150.427100:0:13189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06611180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875726218392704:0@lo:104: 00010000:00010000:2.0:1788832150.427135:0:13189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d2c00031000/0x998c12b2835370c7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.427356:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c092dda00/0x998c12b283537065 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353706c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.427364:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832150.427388:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dda00/0x998c12b283537065 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353706c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.427395:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c092dda00/0x998c12b283537065 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353706c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.427408:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832150.427410:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832150.427412:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832150.427425:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b074f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218393088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788832150.427468:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832150.427516:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218393088 00000100:00100000:0.0:1788832150.427521:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218393088 00010000:00010000:0.0:1788832150.427542:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c092ddc00/0x998c12b28353706c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283537065 expref: 22 pid: 6519 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832150.427567:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788832150.427575:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+22:3652:x1875726218393088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832150.427585:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832150.427590:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c092ddc00/0x998c12b28353706c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283537065 expref: 22 pid: 6519 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.427600:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c092ddc00/0x998c12b28353706c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283537065 expref: 22 pid: 6519 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.427613:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c092ddc00/0x998c12b28353706c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283537065 expref: 22 pid: 6519 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.427659:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832150.427699:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e55f0905-9d39-4464-9830-326b420fb582+21:3652:x1875726218393088:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832150.427714:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788832150.427747:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b074f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218393088:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832150.429857:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832150.429864:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832150.432484:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b283537057 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353705e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832150.432502:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788832150.432534:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b283537057 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353705e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832150.432544:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b283537057 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353705e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832150.432568:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832150.432571:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832150.432574:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832150.432710:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218393216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788832150.432867:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832150.432955:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218393216 00000100:00100000:0.0:1788832150.432963:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218393216 00010000:00010000:0.0:1788832150.432993:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c092dc200/0x998c12b28353705e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283537057 expref: 21 pid: 6519 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832150.433032:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788832150.433042:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18e24c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e55f0905-9d39-4464-9830-326b420fb582+21:3653:x1875726218393216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832150.433055:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832150.433062:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c092dc200/0x998c12b28353705e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283537057 expref: 21 pid: 6519 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.433074:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c092dc200/0x998c12b28353705e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283537057 expref: 21 pid: 6519 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.433097:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c092dc200/0x998c12b28353705e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283537057 expref: 21 pid: 6519 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.433112:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d2c00031000/0x998c12b2835370c7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.433121:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c00031000/0x998c12b2835370c7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.433155:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c00031000/0x998c12b2835370c7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.433163:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c00031000/0x998c12b2835370c7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.433170:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d2c00031000/0x998c12b2835370c7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.433178:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d2c00031000/0x998c12b2835370c7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.433184:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031000 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:0.0:1788832150.433188:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d2c00031000/0x998c12b2835370c7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.433197:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d2c00031000/0x998c12b2835370c7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.433218:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d2c00031000/0x998c12b2835370c7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832150.433228:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832150.433274:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18e24c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e55f0905-9d39-4464-9830-326b420fb582+20:3653:x1875726218393216:12345-0@lo:103:ldlm_bl.0 Request processed in 234us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832150.433283:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788832150.433511:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218393216:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788832150.434204:0:13189:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d2c00031000/0x998c12b2835370c7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832150.434216:0:13189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d2c00031000/0x998c12b2835370c7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832150.434223:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c00031000/0x998c12b2835370c7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832150.742870:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788832150.745830:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218393344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788832150.745898:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832150.746010:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218393344 00000100:00100000:2.0:1788832150.746018:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218393344 00000100:00100000:2.0:1788832150.746063:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788832150.746072:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218393344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788832150.746113:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788832150.746160:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218393344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832150.746167:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788832150.746248:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218393344:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788832150.999418:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832151.256146:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218393472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832151.256384:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832151.256822:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218393472 00000100:00100000:0.0:1788832151.256831:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218393472 00000100:00100000:0.0:1788832151.256886:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788832151.256895:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218393472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788832151.256922:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832151.256967:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218393472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832151.256974:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788832151.256994:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788832151.257020:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0767df80 x1875726218393472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832151.257037:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218393472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832151.259173:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832151.259720:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832151.259737:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218393984:0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.259817:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832151.259866:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218393984 00000100:00100000:2.0:1788832151.259872:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218393984 00000100:00100000:2.0:1788832151.259910:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788832151.259918:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218393984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.259959:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218393984:12345-0@lo:400:kworker.0 Request processed in 43us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832151.259965:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788832151.260002:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218393984:0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.260033:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218394112:0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.260056:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832151.260078:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218394112 00000100:00100000:2.0:1788832151.260081:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218394112 00000100:00100000:2.0:1788832151.260114:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788832151.260119:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218394112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.260148:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218394112:12345-0@lo:400:kworker.0 Request processed in 29us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832151.260154:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788832151.260175:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218394112:0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.260449:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832151.260454:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218394496:0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.260477:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832151.260507:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218394624:0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.260524:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832151.260560:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832151.260572:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218395008:0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.260591:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832151.261753:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218394496 00000100:00100000:2.0:1788832151.261762:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218394496 00000100:00100000:2.0:1788832151.261916:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218394624 00000100:00100000:2.0:1788832151.261920:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218394624 00000100:00100000:2.0:1788832151.261939:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218395008 00000100:00100000:2.0:1788832151.261941:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218395008 00000100:00100000:2.0:1788832151.261959:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788832151.261967:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218394496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.262029:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218394496:12345-0@lo:400:kworker.0 Request processed in 63us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832151.262035:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788832151.262049:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788832151.262054:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218394624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.262082:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218394624:12345-0@lo:400:kworker.0 Request processed in 28us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832151.262098:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788832151.262110:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788832151.262115:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218395008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.262142:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218395008:12345-0@lo:400:kworker.0 Request processed in 27us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832151.262148:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788832151.262171:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218393856:0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.262325:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832151.262357:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218394368:0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.262380:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832151.262417:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218394880:0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.262439:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832151.262462:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788832151.262468:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875726218393728:0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.262486:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832151.262500:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218394240:0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.262518:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832151.262534:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1875726218394752:0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.262552:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832151.262580:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218393856 00000100:00100000:2.0:1788832151.262584:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218393856 00000100:00100000:2.0:1788832151.262609:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788832151.262615:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218393856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.262678:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218393856:12345-0@lo:400:kworker.0 Request processed in 62us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832151.264239:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218393600:0@lo:400:kworker.0 00000100:00100000:3.0:1788832151.264300:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832151.264386:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218393600 00000100:00100000:3.0:1788832151.264392:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218393600 00000100:00100000:3.0:1788832151.264433:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788832151.264440:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+20:3651:x1875726218393600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832151.264486:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+20:3651:x1875726218393600:12345-0@lo:400:kworker.0 Request processed in 46us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832151.264493:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788832151.264540:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218393600:0@lo:400:kworker.0 00000100:00100000:3.0:1788832151.264587:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218394368 00000100:00100000:3.0:1788832151.264590:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218394368 00000100:00100000:3.0:1788832151.264611:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218394880 00000100:00100000:3.0:1788832151.264614:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218394880 00000100:00100000:3.0:1788832151.264646:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218393728 00000100:00100000:3.0:1788832151.264649:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218393728 00000100:00100000:3.0:1788832151.264659:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218394240 00000100:00100000:3.0:1788832151.264661:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218394240 00000100:00100000:3.0:1788832151.264672:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218394752 00000100:00100000:3.0:1788832151.264674:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218394752 00000100:00100000:3.0:1788832151.264701:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788832151.264707:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218394368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832151.264766:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218394368:12345-0@lo:400:kworker.0 Request processed in 59us (2385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832151.264773:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788832151.264787:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788832151.264793:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218394880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.265390:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788832151.265420:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788832151.265429:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875726218393728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.265472:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875726218393728:12345-0@lo:400:kworker.0 Request processed in 44us (2984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832151.265478:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788832151.265493:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788832151.265498:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218394240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.265523:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218394240:12345-0@lo:400:kworker.0 Request processed in 26us (3004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832151.265540:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788832151.265553:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788832151.265559:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875726218394752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.265590:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875726218394752:12345-0@lo:400:kworker.0 Request processed in 32us (3037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832151.265595:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788832151.265654:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875726218393728:0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.265665:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218394240:0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.265676:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1875726218394752:0@lo:400:kworker.0 00000100:00100000:2.0:1788832151.266053:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218393856:0@lo:400:kworker.0 00000100:00100000:3.0:1788832151.266111:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218394880:12345-0@lo:400:kworker.0 Request processed in 1317us (3669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832151.266118:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00010000:00080000:3.0:1788832151.266158:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3e776d80 x1875726218395008/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832151.266170:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218395008:0@lo:400:kworker.0 00010000:00080000:3.0:1788832151.266507:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b06613b80 x1875726218394624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832151.266518:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218394624:0@lo:400:kworker.0 00000100:00080000:0.0:1788832151.266643:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788832151.266648:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788832151.266651:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788832151.266653:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788832151.267599:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c182a8000 x1875726218394368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832151.267612:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218394368:0@lo:400:kworker.0 00010000:00080000:2.0:1788832151.267641:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3e777100 x1875726218394880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832151.267649:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218394880:0@lo:400:kworker.0 00010000:00080000:3.0:1788832151.268021:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c182ab100 x1875726218394496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832151.268032:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218394496:0@lo:400:kworker.0 00000100:00100000:3.0:1788832151.766856:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b074f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218395136:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788832151.766925:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832151.770991:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218395136 00000100:00100000:0.0:1788832151.771006:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218395136 00000100:00100000:0.0:1788832151.771063:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788832151.771073:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218395136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788832151.771111:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832151.771195:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218395136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (4270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832151.771202:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1788832151.771964:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b074f7100 x1875726218395136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832151.771989:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b074f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218395136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788832151.957410:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832151.957859:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202587136 00000100:00100000:1.0:1788832151.957870:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202587136 00000100:00100000:1.0:1788832151.957916:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 311 00000100:00100000:1.0:1788832151.957926:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+11:6168:x1875726202587136:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788832151.957952:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832151.957972:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c390f2e00/0x998c12b2835370ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc045d8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832151.957998:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c390f2e00/0x998c12b2835370ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045d8 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832151.958010:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c390f2e00/0x998c12b2835370ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045d8 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832151.958020:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c390f2e00, rc 0) 00000100:00100000:1.0:1788832151.958090:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+12:6168:x1875726202587136:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 157us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832151.958098:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 311 00000100:00100000:1.0:1788832151.963675:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832151.966432:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202587264 00000100:00100000:2.0:1788832151.966449:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202587264 00000100:00100000:2.0:1788832151.966526:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 312 00000100:00100000:2.0:1788832151.966537:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+12:6168:x1875726202587264:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832151.967804:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+12:6168:x1875726202587264:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 1262us (4135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832151.967827:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 312 00000100:00100000:3.0:1788832151.976912:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832151.977059:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202587392 00000100:00100000:0.0:1788832151.977069:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202587392 00000100:00100000:0.0:1788832151.977133:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 313 00000100:00100000:0.0:1788832151.977153:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+12:6168:x1875726202587392:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832151.977304:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+12:6168:x1875726202587392:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 152us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832151.977312:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 313 00000100:00100000:0.0:1788832151.985184:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832151.985556:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202587520 00000100:00100000:2.0:1788832151.985567:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202587520 00000100:00100000:2.0:1788832151.985645:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 314 00000100:00100000:2.0:1788832151.985657:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+12:6168:x1875726202587520:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832151.985675:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832151.985693:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c00030a00/0x998c12b2835370d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc045df expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832151.985723:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c00030a00/0x998c12b2835370d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045df expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832151.985734:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c00030a00/0x998c12b2835370d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045df expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832151.985742:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00030a00, rc 0) 00000100:00100000:2.0:1788832151.986152:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:6168:x1875726202587520:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 497us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832151.986160:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 314 00000100:00100000:0.0:1788832151.996482:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832151.996663:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202587648 00000100:00100000:3.0:1788832151.996673:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202587648 00000100:00100000:3.0:1788832151.996724:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 315 00000100:00100000:3.0:1788832151.996735:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:6168:x1875726202587648:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832151.996889:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:6168:x1875726202587648:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 156us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832151.996897:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 315 00000100:00100000:3.0:1788832152.003276:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832152.003351:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202587776 00000100:00100000:2.0:1788832152.003362:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202587776 00000100:00100000:2.0:1788832152.003412:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 316 00000100:00100000:2.0:1788832152.003423:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:6168:x1875726202587776:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832152.003553:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:6168:x1875726202587776:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 131us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832152.003560:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 316 00010000:00010000:0.0:1788832152.028420:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832152.279819:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b074f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218395264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788832152.279887:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832152.280113:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218395264 00000100:00100000:2.0:1788832152.280121:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218395264 00000100:00100000:2.0:1788832152.280163:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788832152.280171:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218395264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788832152.280199:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788832152.280250:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218395264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832152.280257:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1788832152.280421:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b074f5500 x1875726218395264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832152.280443:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b074f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218395264:0@lo:13:osp-pre-0-1.0 10000000:01000000:3.0:1788832152.409857:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788832152.409868:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2c3fcaa000 from 7 10000000:01000000:3.0:1788832152.409874:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788832152.409930:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835370dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832152.409943:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835370dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832152.409954:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835370dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832152.409980:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218395392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788832152.410064:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832152.410138:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788832152.410211:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218395392 00000100:00100000:1.0:1788832152.410218:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218395392 00000100:00100000:1.0:1788832152.410275:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788832152.410284:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+20:6522:x1875726218395392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788832152.410326:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832152.410341:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c390f2400/0x998c12b2835370e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b2835370dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832152.410364:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c390f2400/0x998c12b2835370e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b2835370dc expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832152.410384:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c390f2400/0x998c12b2835370e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835370dc expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832152.410393:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c390f2400, rc 0) 00000100:00100000:1.0:1788832152.410429:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218395392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832152.410435:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788832152.410688:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218395392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832152.410703:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835370dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835370e3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832152.410713:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835370dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b2835370e3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832152.410769:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218395520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832152.410792:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832152.410817:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788832152.412465:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218395520 00000100:00100000:1.0:1788832152.412479:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218395520 00000100:00100000:1.0:1788832152.412541:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788832152.412552:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218395520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832152.412727:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218395520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (1932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832152.412734:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788832152.412778:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218395520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832152.412819:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07778e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218395648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788832152.414123:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832152.414163:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c089edf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788832152.414185:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218395648 00000100:00100000:1.0:1788832152.414189:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218395648 00000100:00100000:1.0:1788832152.414228:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788832152.414234:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218395648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788832152.414322:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218395648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832152.414328:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788832152.414373:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07778e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218395648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788832152.415220:0:13292:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788832152.415293:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788832152.415313:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788832152.415324:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835370dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835370e3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832152.415335:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835370dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835370e3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832152.415345:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788832152.415348:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2c3e677800 from 7 10000000:01000000:1.0:1788832152.415351:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788832152.415383:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b2835370ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832152.415391:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b2835370ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832152.415402:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b2835370ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832152.415423:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07778e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218395776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788832152.415473:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832152.415508:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06589d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788832152.415524:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218395776 00000100:00100000:1.0:1788832152.415530:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218395776 00000100:00100000:1.0:1788832152.415564:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788832152.415571:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218395776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788832152.415583:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832152.415597:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c390f2800/0x998c12b2835370f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b2835370ea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832152.415644:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c390f2800/0x998c12b2835370f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b2835370ea expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832152.415655:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c390f2800/0x998c12b2835370f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835370ea expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832152.415662:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c390f2800, rc 0) 00000100:00100000:1.0:1788832152.415692:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218395776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832152.415697:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788832152.415739:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07778e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218395776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788832152.415753:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b2835370ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835370f1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832152.415761:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b2835370ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b2835370f1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832152.415804:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07778e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218395904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832152.415829:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832152.415848:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06589d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788832152.415858:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218395904 00000100:00100000:1.0:1788832152.415862:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218395904 00000100:00100000:1.0:1788832152.415882:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788832152.415890:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218395904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832152.420395:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218395904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4498us (4556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832152.420408:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788832152.420569:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07778e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218395904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832152.420639:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218396032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832152.420697:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832152.420738:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b0720da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832152.420800:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218396032 00000100:00100000:3.0:1788832152.420807:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218396032 00000100:00100000:3.0:1788832152.420854:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788832152.420863:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218396032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832152.420977:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218396032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832152.420984:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788832152.422508:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218396032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788832152.429416:0:13293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788832152.429706:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788832152.429730:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788832152.429740:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b2835370ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835370f1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832152.429752:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b2835370ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835370f1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832152.429763:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788832152.429765:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2c39185800 from 7 10000000:01000000:0.0:1788832152.429768:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788832152.429802:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b2835370f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832152.429810:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b2835370f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832152.429830:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b2835370f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832152.429854:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b074f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218396160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788832152.429916:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832152.429957:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b077db300 going to sleep for 11 seconds 00000100:00100000:2.0:1788832152.430030:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218396160 00000100:00100000:2.0:1788832152.430038:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218396160 00000100:00100000:2.0:1788832152.430097:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788832152.430105:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218396160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832152.430119:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832152.430131:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c00031c00/0x998c12b2835370ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b2835370f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832152.430151:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c00031c00/0x998c12b2835370ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b2835370f8 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832152.430161:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c00031c00/0x998c12b2835370ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835370f8 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832152.430180:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031c00, rc 0) 00000100:00100000:2.0:1788832152.430226:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218396160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832152.430233:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788832152.430491:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b074f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218396160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832152.430505:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b2835370f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835370ff expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832152.430515:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b2835370f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b2835370ff expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832152.430575:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b074f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218396288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832152.430602:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832152.430614:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b077db300 going to sleep for 11 seconds 00000100:00100000:3.0:1788832152.430761:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218396288 00000100:00100000:3.0:1788832152.430766:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218396288 00000100:00100000:3.0:1788832152.430791:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788832152.430797:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218396288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832152.430903:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218396288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832152.430910:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788832152.430939:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b074f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218396288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832152.430967:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218396416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832152.431003:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832152.431026:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832152.431037:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218396416 00000100:00100000:3.0:1788832152.431040:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218396416 00000100:00100000:3.0:1788832152.431056:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788832152.431061:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218396416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832152.431140:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218396416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832152.431147:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788832152.431186:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218396416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788832152.434060:0:13294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788832152.434511:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788832152.434537:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788832152.434549:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b2835370f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835370ff expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832152.434560:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b2835370f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835370ff expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832152.434571:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788832152.434573:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2c40623800 from 7 10000000:01000000:3.0:1788832152.434576:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788832152.434615:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b283537106 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832152.434654:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b283537106 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832152.434665:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b283537106 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832152.434689:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218396544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788832152.434752:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832152.434793:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832152.434905:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218396544 00000100:00100000:0.0:1788832152.434912:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218396544 00000100:00100000:0.0:1788832152.434962:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788832152.434972:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218396544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832152.434987:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832152.435000:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c36db9800/0x998c12b28353710d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283537106 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832152.435023:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c36db9800/0x998c12b28353710d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283537106 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832152.435047:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c36db9800/0x998c12b28353710d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283537106 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832152.435055:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c36db9800, rc 0) 00000100:00100000:0.0:1788832152.435102:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:6522:x1875726218396544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832152.435109:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788832152.435214:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218396544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832152.435229:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b283537106 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353710d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832152.435239:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b283537106 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b28353710d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832152.435435:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218396672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832152.435462:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832152.435492:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832152.436741:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218396672 00000100:00100000:0.0:1788832152.436751:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218396672 00000100:00100000:0.0:1788832152.436793:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788832152.436801:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:6522:x1875726218396672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832152.436963:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:6522:x1875726218396672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (1499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832152.436970:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788832152.437049:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218396672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832152.437106:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218396800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832152.437158:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832152.437190:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b0720d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788832152.437247:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218396800 00000100:00100000:3.0:1788832152.437252:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218396800 00000100:00100000:3.0:1788832152.437279:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788832152.437286:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:6522:x1875726218396800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832152.437371:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:6522:x1875726218396800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832152.437378:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788832152.437463:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218396800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788832152.441857:0:13295:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788832152.441968:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788832152.441992:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788832152.442003:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b283537106 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353710d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832152.442015:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b283537106 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353710d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832152.791610:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b074f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218396928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788832152.791682:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832152.792806:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218396928 00000100:00100000:2.0:1788832152.792817:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218396928 00000100:00100000:2.0:1788832152.792876:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788832152.792886:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218396928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788832152.792908:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788832152.792964:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218396928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832152.792971:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1788832152.793009:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b074f4700 x1875726218396928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832152.793027:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b074f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218396928:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788832153.051009:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832153.300650:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832153.300686:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832153.300716:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832153.300736:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832153.300760:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832153.300786:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202588032 00000100:00100000:0.0:1788832153.300795:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202588032 00000100:00100000:0.0:1788832153.300841:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202588288 00000100:00100000:0.0:1788832153.300844:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202588288 00000100:00100000:0.0:1788832153.300855:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202588160 00000100:00100000:0.0:1788832153.300866:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202588160 00000100:00100000:0.0:1788832153.300880:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202588416 00000100:00100000:0.0:1788832153.300883:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202588416 00000100:00100000:0.0:1788832153.300896:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 179 00000100:00100000:0.0:1788832153.300905:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+6:2396:x1875726202588032:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832153.300979:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+6:2396:x1875726202588032:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 73us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832153.300988:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 179 00000100:00100000:0.0:1788832153.301006:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 180 00000100:00100000:0.0:1788832153.301012:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202588288:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832153.301036:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202588288:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 25us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832153.301042:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 180 00000100:00100000:0.0:1788832153.301054:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 181 00000100:00100000:0.0:1788832153.301060:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202588160:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832153.301093:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202588160:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 33us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832153.301099:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 181 00000100:00100000:0.0:1788832153.301111:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 182 00000100:00100000:0.0:1788832153.301117:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202588416:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832153.301140:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202588416:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832153.301146:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 182 00000100:00100000:0.0:1788832153.301164:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202587904 00000100:00100000:0.0:1788832153.301174:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202587904 00000100:00100000:0.0:1788832153.301200:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 329 00000100:00100000:0.0:1788832153.301206:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2396:x1875726202587904:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832153.301233:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2396:x1875726202587904:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832153.301238:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 329 00000100:00080000:0.0:1788832153.301269:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788832153.301273:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1788832153.886357:0:13389:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788832154.074936:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832155.094846:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832155.351283:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832155.351312:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218397056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832155.351387:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832155.351545:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218397056 00000100:00100000:3.0:1788832155.351553:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218397056 00000100:00100000:3.0:1788832155.351602:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788832155.351639:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218397056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788832155.351676:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788832155.352094:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218397056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 476us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832155.352113:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788832155.352196:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218397056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788832155.870324:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832155.870349:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218397184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788832155.870412:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832155.870471:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218397184 00000100:00100000:3.0:1788832155.870479:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218397184 00000100:00100000:3.0:1788832155.870523:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788832155.870532:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218397184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788832155.870565:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788832155.870612:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218397184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832155.870644:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788832155.870689:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218397184:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788832156.119190:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832156.378073:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218397312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832156.378157:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832156.378599:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218397312 00000100:00100000:3.0:1788832156.378607:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218397312 00000100:00100000:3.0:1788832156.378702:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788832156.378713:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218397312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788832156.378744:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832156.378811:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218397312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832156.378818:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:3.0:1788832156.378859:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0767e680 x1875726218397312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832156.378879:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218397312:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788832156.380809:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788832156.384006:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218397440:0@lo:400:kworker.0 00000100:00100000:2.0:1788832156.384099:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832156.384327:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218397824:0@lo:400:kworker.0 00000100:00100000:3.0:1788832156.384379:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832156.384445:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218397568:0@lo:400:kworker.0 00000100:00100000:3.0:1788832156.384471:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832156.384491:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832156.384497:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218397696:0@lo:400:kworker.0 00000100:00100000:3.0:1788832156.384522:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832156.384553:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218397696 00000100:00100000:3.0:1788832156.384561:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218397696 00000100:00100000:3.0:1788832156.384606:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788832156.384614:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218397696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832156.384699:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218397696:12345-0@lo:400:kworker.0 Request processed in 85us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832156.384705:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788832156.384748:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218397696:0@lo:400:kworker.0 00000100:00100000:3.0:1788832156.384800:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218397824 00000100:00100000:3.0:1788832156.384804:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218397824 00000100:00100000:3.0:1788832156.384829:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218397568 00000100:00100000:3.0:1788832156.384832:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218397568 00000100:00100000:3.0:1788832156.384851:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788832156.384858:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218397824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832156.384895:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218397824:12345-0@lo:400:kworker.0 Request processed in 37us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832156.384901:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788832156.384914:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788832156.384920:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218397568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832156.384953:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218397568:12345-0@lo:400:kworker.0 Request processed in 33us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832156.384966:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788832156.384995:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218397568:0@lo:400:kworker.0 00000100:00100000:3.0:1788832156.385017:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218397824:0@lo:400:kworker.0 00000100:00100000:1.0:1788832156.385451:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218397440 00000100:00100000:1.0:1788832156.385456:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218397440 00000100:00100000:1.0:1788832156.385496:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788832156.385504:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3654:x1875726218397440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832156.393087:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1875726218398208:0@lo:400:kworker.0 00000100:00100000:0.0:1788832156.393158:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832156.393191:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218398720:0@lo:400:kworker.0 00000100:00100000:0.0:1788832156.393213:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832156.393236:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788832156.393242:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1875726218398080:0@lo:400:kworker.0 00000100:00100000:0.0:1788832156.393264:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832156.393282:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1875726218398592:0@lo:400:kworker.0 00000100:00100000:0.0:1788832156.393302:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832156.393330:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218398208 00000100:00100000:0.0:1788832156.393337:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218398208 00000100:00100000:0.0:1788832156.393384:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218398720 00000100:00100000:0.0:1788832156.393387:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218398720 00000100:00100000:0.0:1788832156.393402:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218398080 00000100:00100000:0.0:1788832156.393404:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218398080 00000100:00100000:0.0:1788832156.393414:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218398592 00000100:00100000:0.0:1788832156.393416:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218398592 00000100:00100000:0.0:1788832156.393430:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788832156.393437:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875726218398208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832156.393500:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875726218398208:12345-0@lo:400:kworker.0 Request processed in 62us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832156.393508:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788832156.393523:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788832156.393529:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875726218398720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832156.393553:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875726218398720:12345-0@lo:400:kworker.0 Request processed in 24us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832156.393559:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788832156.393568:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788832156.393574:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875726218398080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832156.393598:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875726218398080:12345-0@lo:400:kworker.0 Request processed in 25us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832156.393604:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788832156.393614:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788832156.393643:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875726218398592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832156.397547:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875726218398592:12345-0@lo:400:kworker.0 Request processed in 3921us (4236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832156.397561:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788832156.397661:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1875726218398080:0@lo:400:kworker.0 00000100:00100000:0.0:1788832156.397676:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1875726218398592:0@lo:400:kworker.0 00010000:00080000:0.0:1788832156.397691:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36d0e300 x1875726218398208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832156.397701:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1875726218398208:0@lo:400:kworker.0 00010000:00080000:0.0:1788832156.397732:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f0000 x1875726218398720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832156.397741:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218398720:0@lo:400:kworker.0 00000100:00080000:0.0:1788832156.397919:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788832156.397925:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788832156.398042:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218398336:0@lo:400:kworker.0 00000100:00100000:3.0:1788832156.398096:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832156.398133:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218398848:0@lo:400:kworker.0 00000100:00100000:3.0:1788832156.398155:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832156.398190:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788832156.398197:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218397952:0@lo:400:kworker.0 00000100:00100000:3.0:1788832156.398220:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832156.398239:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218398464:0@lo:400:kworker.0 00000100:00100000:3.0:1788832156.398257:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832156.398289:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218398336 00000100:00100000:3.0:1788832156.398295:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218398336 00000100:00100000:3.0:1788832156.398339:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218398848 00000100:00100000:3.0:1788832156.398342:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218398848 00000100:00100000:3.0:1788832156.398363:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218398464 00000100:00100000:3.0:1788832156.398365:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218398464 00000100:00100000:3.0:1788832156.398382:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788832156.398390:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218398336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832156.398434:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218398336:12345-0@lo:400:kworker.0 Request processed in 45us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832156.398440:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788832156.398457:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788832156.398463:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218398848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832156.398502:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218398848:12345-0@lo:400:kworker.0 Request processed in 39us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832156.398508:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788832156.398521:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788832156.398527:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218398464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832156.398555:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218398464:12345-0@lo:400:kworker.0 Request processed in 29us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832156.398560:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788832156.398586:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218397952 00000100:00100000:3.0:1788832156.398592:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218397952 00000100:00100000:3.0:1788832156.398702:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788832156.398714:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218397952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832156.398788:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218397952:12345-0@lo:400:kworker.0 Request processed in 54us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832156.398797:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788832156.398862:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218397952:0@lo:400:kworker.0 00010000:00080000:3.0:1788832156.398880:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36d0df80 x1875726218398464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832156.398892:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218398464:0@lo:400:kworker.0 00010000:00080000:3.0:1788832156.398907:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36d0f480 x1875726218398336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832156.398915:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218398336:0@lo:400:kworker.0 00010000:00080000:3.0:1788832156.398925:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f1500 x1875726218398848/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832156.398966:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218398848:0@lo:400:kworker.0 00000100:00080000:0.0:1788832156.401738:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788832156.401751:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832156.402502:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3654:x1875726218397440:12345-0@lo:400:kworker.0 Request processed in 16993us (18396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832156.402515:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788832156.409667:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218397440:0@lo:400:kworker.0 00000100:00100000:2.0:1788832156.887265:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218398976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788832156.887334:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832156.887510:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218398976 00000100:00100000:3.0:1788832156.887519:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218398976 00000100:00100000:3.0:1788832156.887571:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788832156.887580:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218398976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788832156.887600:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832156.887684:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218398976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832156.887691:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:0.0:1788832156.887785:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f0000 x1875726218398976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832156.887803:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218398976:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788832157.144448:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832157.400135:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218399104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788832157.400204:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832157.400336:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218399104 00000100:00100000:0.0:1788832157.400344:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218399104 00000100:00100000:0.0:1788832157.400405:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788832157.400417:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218399104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788832157.400445:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832157.400487:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218399104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832157.400493:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:3.0:1788832157.400614:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f0000 x1875726218399104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832157.400653:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218399104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788832157.915756:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832157.915781:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218399232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788832157.915848:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832157.915953:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218399232 00000100:00100000:0.0:1788832157.915962:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218399232 00000100:00100000:0.0:1788832157.916017:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788832157.916026:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218399232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788832157.916058:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832157.916109:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218399232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832157.916116:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:0.0:1788832157.916170:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b067f2a00 x1875726218399232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832157.916189:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218399232:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788832158.166940:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832158.425096:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832158.425136:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832158.425164:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832158.425192:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832158.425219:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832158.425244:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202588800 00000100:00100000:0.0:1788832158.425252:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202588800 00000100:00100000:0.0:1788832158.425297:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202589056 00000100:00100000:0.0:1788832158.425300:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202589056 00000100:00100000:0.0:1788832158.425312:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202588672 00000100:00100000:0.0:1788832158.425314:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202588672 00000100:00100000:0.0:1788832158.425324:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202588928 00000100:00100000:0.0:1788832158.425327:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202588928 00000100:00100000:0.0:1788832158.425341:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 189 00000100:00100000:0.0:1788832158.425351:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202588800:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832158.425422:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202588800:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 72us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832158.425429:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 189 00000100:00100000:0.0:1788832158.425444:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 190 00000100:00100000:0.0:1788832158.425450:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202589056:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832158.425473:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202589056:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 23us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832158.425479:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 190 00000100:00100000:0.0:1788832158.425505:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 191 00000100:00100000:0.0:1788832158.425511:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+6:2396:x1875726202588672:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832158.425534:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+6:2396:x1875726202588672:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832158.425540:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 191 00000100:00100000:0.0:1788832158.425551:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 192 00000100:00100000:0.0:1788832158.425557:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202588928:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832158.425576:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202588928:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 20us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832158.425582:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 192 00000100:00080000:0.0:1788832158.425600:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788832158.425604:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788832158.428136:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202588544 00000100:00100000:3.0:1788832158.428151:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202588544 00000100:00100000:3.0:1788832158.428221:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 331 00000100:00100000:3.0:1788832158.428232:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2396:x1875726202588544:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832158.428969:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2396:x1875726202588544:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 735us (3876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832158.428995:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 331 00000001:02000400:1.0:1788832159.171692:0:13537:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 21:49:18 (1788832158) === 00010000:00010000:2.0:1788832159.190754:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832159.446260:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832159.446358:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832159.447399:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202589184 00000100:00100000:1.0:1788832159.447410:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202589184 00000100:00100000:1.0:1788832159.447476:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:1.0:1788832159.447485:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+6:2394:x1875726202589184:12345-192.168.203.26@tcp:41:mkdir.0 00000004:00000024:1.0:1788832159.447527:0:8742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788832159.447658:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+6:2394:x1875726202589184:12345-192.168.203.26@tcp:41:mkdir.0 Request processed in 174us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832159.447681:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:0.0:1788832159.449299:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202589312 00000100:00100000:0.0:1788832159.449309:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202589312 00000100:00100000:0.0:1788832159.449363:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:0.0:1788832159.449373:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:352fff76-09db-42cd-818a-16e788a01abb+6:10498:x1875726202589312:12345-192.168.203.26@tcp:700:mkdir.0 00000100:00100000:0.0:1788832159.449456:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:352fff76-09db-42cd-818a-16e788a01abb+6:10498:x1875726202589312:12345-192.168.203.26@tcp:700:mkdir.0 Request processed in 84us (3204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832159.449464:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:0.0:1788832159.456312:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832159.456378:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202589568 00000100:00100000:2.0:1788832159.456388:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202589568 00000100:00100000:2.0:1788832159.456443:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:2.0:1788832159.456453:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+6:10498:x1875726202589568:12345-192.168.203.26@tcp:36:mkdir.0 00010000:00010000:2.0:1788832159.456505:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832159.456556:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b283536fb6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04553 expref: 6 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.456576:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c36bdb000) 00010000:00010000:2.0:1788832159.456587:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788832159.456714:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537114 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.456728:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537114 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.456738:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537114 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.456774:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b28353711b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.456782:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b28353711b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.456789:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b28353711b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.458893:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537122 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.458969:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.458981:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788832159.459004:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091ab7354 reply state 00000000a294d0ba transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537122 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.459015:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537122 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.459022:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d2c36bdbd00) 00010000:00010000:2.0:1788832159.459025:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788832159.459039:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788832159.459044:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788832159.459052:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537114 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.459059:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537114 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.459077:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537114 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.459083:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030c00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832159.459088:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537114 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.459096:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537114 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.459106:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c36bdb400) 00010000:00010000:2.0:1788832159.459109:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832159.459112:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537114 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.459118:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537114 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788832159.459139:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091ab7354 reply state 00000000a294d0ba transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b28353711b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.459147:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b28353711b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.459153:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d2c36bdb600) 00010000:00010000:2.0:1788832159.459155:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788832159.459157:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788832159.459340:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+7:10498:x1875726202589568:12345-192.168.203.26@tcp:36:mkdir.0 Request processed in 2884us (3033us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788832159.459349:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:1.0:1788832159.471725:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832159.472175:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202589696 00000100:00100000:0.0:1788832159.472187:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202589696 00000100:00100000:0.0:1788832159.472255:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:0.0:1788832159.472267:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0777a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+7:10501:x1875726202589696:12345-192.168.203.26@tcp:101:chmod.0 00010000:00010000:0.0:1788832159.472307:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832159.472337:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537129 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc045e6 expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.472413:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537130 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.472427:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537130 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.472439:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537130 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832159.472484:0:8742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788832159.472487:0:8742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788832159.472523:0:8742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537130 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.472549:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537129 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045e6 expref: 9 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.472566:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537130 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045e6 expref: 8 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.472575:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c3919d500) 00010000:00010000:0.0:1788832159.472577:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788832159.472581:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c36db8400, rc 0) 00000100:00100000:0.0:1788832159.472826:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0777a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+8:10501:x1875726202589696:12345-192.168.203.26@tcp:101:chmod.0 Request processed in 560us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832159.472833:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:0.0:1788832159.478011:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832159.478107:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202589952 00000100:00100000:1.0:1788832159.478117:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202589952 00000100:00100000:1.0:1788832159.478179:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:1.0:1788832159.478189:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+8:10501:x1875726202589952:12345-192.168.203.26@tcp:36:chmod.0 00010000:00010000:1.0:1788832159.478245:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832159.478272:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537130 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045e6 expref: 8 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.478293:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c3919d500) 00010000:00010000:1.0:1788832159.478305:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788832159.478330:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b283537137 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.478343:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b283537137 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.478353:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b283537137 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788832159.478544:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e70a198 reply state 000000004bee1710 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b283537137 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.478559:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b283537137 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.478565:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c100ce100) 00010000:00010000:1.0:1788832159.478568:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788832159.478577:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788832159.478584:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788832159.478925:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+9:10501:x1875726202589952:12345-192.168.203.26@tcp:36:chmod.0 Request processed in 734us (922us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788832159.478935:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:3.0:1788832159.509564:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832159.515934:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202590080 00000100:00100000:2.0:1788832159.515951:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202590080 00000100:00100000:2.0:1788832159.516016:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:2.0:1788832159.516038:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+9:10502:x1875726202590080:12345-192.168.203.26@tcp:101:chown.0 00010000:00010000:2.0:1788832159.516066:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832159.516086:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b28353713e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc045ed expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.516158:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537145 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.516173:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537145 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.516184:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537145 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832159.516227:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788832159.516231:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788832159.516269:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537145 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.516295:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b28353713e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045ed expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.516316:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537145 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045ed expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.516326:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c100ce100) 00010000:00010000:2.0:1788832159.516329:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788832159.516347:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00030600, rc 0) 00000100:00100000:2.0:1788832159.516426:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+10:10502:x1875726202590080:12345-192.168.203.26@tcp:101:chown.0 Request processed in 399us (6871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832159.516433:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:1.0:1788832159.521008:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832159.521103:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202590208 00000100:00100000:0.0:1788832159.521113:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202590208 00000100:00100000:0.0:1788832159.521180:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:0.0:1788832159.521191:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0777b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+10:10502:x1875726202590208:12345-192.168.203.26@tcp:101:chown.0 00010000:00010000:0.0:1788832159.521212:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832159.521233:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b28353714c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc045f4 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.521301:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8200/0x998c12b283537153 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.521316:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8200/0x998c12b283537153 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.521328:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8200/0x998c12b283537153 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.521339:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353715a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.521346:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353715a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.521353:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353715a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.521430:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537161 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.521438:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537161 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.521460:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537161 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832159.521501:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788832159.521505:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788832159.521526:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537161 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.521538:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8200/0x998c12b283537153 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.521544:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8200/0x998c12b283537153 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.521551:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8200/0x998c12b283537153 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.521557:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c36db8200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832159.521561:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8200/0x998c12b283537153 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.521569:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8200/0x998c12b283537153 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.521581:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c100ce100) 00010000:00010000:0.0:1788832159.521584:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832159.521588:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8200/0x998c12b283537153 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.521595:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8200/0x998c12b283537153 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.522574:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353715a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.522587:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353715a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.522594:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353715a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.522600:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c36db9a00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832159.522603:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353715a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.522609:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353715a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.523134:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d2c36bdb600) 00010000:00010000:0.0:1788832159.523138:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832159.523143:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353715a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.523150:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353715a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.523201:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b28353714c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045f4 expref: 12 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.523215:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537161 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045f4 expref: 11 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.523245:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d2c36bdbd00) 00010000:00010000:0.0:1788832159.523248:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788832159.523251:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c36db8400, rc 0) 00000100:00100000:0.0:1788832159.523322:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0777b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+11:10502:x1875726202590208:12345-192.168.203.26@tcp:101:chown.0 Request processed in 2132us (2322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832159.523330:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:1.0:1788832159.529081:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832159.529193:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202590336 00000100:00100000:0.0:1788832159.529204:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202590336 00000100:00100000:0.0:1788832159.529267:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:0.0:1788832159.529277:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:352fff76-09db-42cd-818a-16e788a01abb+11:10502:x1875726202590336:12345-192.168.203.26@tcp:900:chown.0 00000100:00100000:0.0:1788832159.529352:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:352fff76-09db-42cd-818a-16e788a01abb+11:10502:x1875726202590336:12345-192.168.203.26@tcp:900:chown.0 Request processed in 76us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832159.529360:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:3.0:1788832159.535446:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832159.535560:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202590592 00000100:00100000:2.0:1788832159.535570:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202590592 00000100:00100000:2.0:1788832159.535680:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:2.0:1788832159.535690:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+11:10502:x1875726202590592:12345-192.168.203.26@tcp:36:chown.0 00010000:00010000:2.0:1788832159.535743:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832159.535783:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537161 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045f4 expref: 11 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.535804:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d2c36bdbd00) 00010000:00010000:2.0:1788832159.535809:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788832159.535831:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537168 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.535844:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537168 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.535852:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537168 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788832159.540354:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1788832159.540480:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b28353711b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.540494:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b28353711b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.540502:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b28353711b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.540508:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832159.540514:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b28353711b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.540521:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b28353711b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.540561:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d2c36bdb600) 00010000:00010000:0.0:1788832159.540565:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832159.540569:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b28353711b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.540576:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b28353711b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.540600:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537122 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.540606:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537122 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.540613:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537122 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.540660:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832159.540664:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537122 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.540670:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537122 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.540679:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d2c36bdbd00) 00010000:00010000:0.0:1788832159.540681:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832159.540684:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537122 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.540689:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537122 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.540715:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b283537137 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.540722:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b283537137 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.540728:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b283537137 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.540733:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832159.540736:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b283537137 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.540755:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b283537137 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.540764:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c100ce100) 00010000:00010000:0.0:1788832159.540767:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788832159.540771:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b283537137 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.540777:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b283537137 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788832159.541007:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c18be6db reply state 000000001ab74be7 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537168 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.541021:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537168 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.541038:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d2c36bdbd00) 00010000:00010000:2.0:1788832159.541047:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788832159.541051:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788832159.541064:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1788832159.541147:0:6525:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788832159.541172:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+7:10502:x1875726202590592:12345-192.168.203.26@tcp:36:chown.0 Request processed in 5480us (5732us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788832159.541180:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 28 00010000:00010000:0.0:1788832159.542083:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537168 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.542094:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537168 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.542100:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537168 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.542112:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030c00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832159.542116:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537168 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.542122:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537168 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.542134:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d2c36bdbd00) 00010000:00010000:0.0:1788832159.542136:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788832159.542139:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537168 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.542145:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537168 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832159.558416:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832159.558498:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202590720 00000100:00100000:2.0:1788832159.558521:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202590720 00000100:00100000:2.0:1788832159.558594:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:2.0:1788832159.558606:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+6:10503:x1875726202590720:12345-192.168.203.26@tcp:101:touch.500 00010000:00010000:2.0:1788832159.558668:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832159.558690:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b28353716f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc045fb expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788832159.560399:0:6526:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1654us 00010000:00010000:0.0:1788832159.596815:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537176 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.596841:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537176 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.596853:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537176 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.596870:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353717d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.596878:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353717d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.596884:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353717d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.597021:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8200/0x998c12b283537184 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.597041:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8200/0x998c12b283537184 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.597048:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8200/0x998c12b283537184 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832159.597076:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788832159.597079:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788832159.597116:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8200/0x998c12b283537184 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.597127:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537176 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.597133:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537176 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.597138:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537176 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.597143:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c36db8e00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832159.597148:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537176 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.597155:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537176 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.597166:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c100ce100) 00010000:00010000:0.0:1788832159.597174:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832159.597178:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537176 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.597184:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537176 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.597195:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353717d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.597200:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353717d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.597206:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353717d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.597210:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c36db9a00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832159.597213:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353717d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.597219:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353717d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.597227:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d2c3919d400) 00010000:00010000:0.0:1788832159.597229:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832159.597232:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353717d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.597238:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353717d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.597275:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b28353716f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045fb expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.597303:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8200/0x998c12b283537184 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045fb expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.597311:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d2c3919dd00) 00010000:00010000:0.0:1788832159.597314:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788832159.597316:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c36db8200, rc 0) 00000100:00100000:0.0:1788832159.597391:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+7:10503:x1875726202590720:12345-192.168.203.26@tcp:101:touch.500 Request processed in 38787us (38985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832159.597399:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:1.0:1788832159.609559:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832159.611476:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202590976 00000100:00100000:0.0:1788832159.611491:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202590976 00000100:00100000:0.0:1788832159.611566:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:0.0:1788832159.611576:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+7:10503:x1875726202590976:12345-192.168.203.26@tcp:101:touch.500 00010000:00010000:0.0:1788832159.611598:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832159.611658:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353718b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04602 expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.611764:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537192 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.611778:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537192 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.611789:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537192 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.622125:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537199 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.622161:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537199 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.622174:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537199 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788832159.622801:0:8742:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788832159.623023:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b2835371a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.623045:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b2835371a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.623054:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b2835371a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.623089:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537192 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.623096:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537192 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.623103:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537192 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.623113:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c36db8e00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832159.623117:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537192 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.623124:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537192 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.623147:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d2c3919dd00) 00010000:00010000:0.0:1788832159.623150:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832159.623154:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537192 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.623159:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8e00/0x998c12b283537192 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788832159.623171:0:8742:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000acb6b0e9 reply state 0000000054ecdfbc transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537199 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.623181:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537199 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.623186:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9d2c3919d400) 00010000:00010000:0.0:1788832159.623188:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788832159.623191:0:8742:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788832159.623225:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db9a00/0x998c12b28353718b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04602 expref: 10 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.623238:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b2835371a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04602 expref: 9 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.623246:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d2c3919d500) 00010000:00010000:0.0:1788832159.623248:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788832159.623250:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0c600, rc 0) 00000100:00100000:0.0:1788832159.623856:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+10:10503:x1875726202590976:12345-192.168.203.26@tcp:101:touch.500 Request processed in 12278us (14315us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788832159.623867:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:2.0:1788832159.629411:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832159.629746:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202591232 00000100:00100000:0.0:1788832159.629756:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202591232 00000100:00100000:0.0:1788832159.629817:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:0.0:1788832159.629827:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+10:10503:x1875726202591232:12345-192.168.203.26@tcp:36:touch.500 00010000:00010000:0.0:1788832159.629885:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832159.629911:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b2835371a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04602 expref: 10 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.629928:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d2c3919d500) 00010000:00010000:0.0:1788832159.629938:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788832159.629985:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b2835371ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.629998:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b2835371ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.630008:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b2835371ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788832159.630125:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059861ff1 reply state 000000004d7da503 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b2835371ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.630138:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b2835371ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832159.630144:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d2c3919d900) 00010000:00010000:0.0:1788832159.630147:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788832159.630149:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788832159.630388:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+11:10503:x1875726202591232:12345-192.168.203.26@tcp:36:touch.500 Request processed in 560us (985us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788832159.630411:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:1.0:1788832159.640827:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832159.640944:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202591360 00000100:00100000:2.0:1788832159.640955:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202591360 00000100:00100000:2.0:1788832159.641089:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 32 00000100:00100000:2.0:1788832159.644223:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+11:10503:x1875726202591360:12345-192.168.203.26@tcp:101:touch.500 00010000:00010000:2.0:1788832159.644260:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832159.644289:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835371b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04609 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.644349:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835371b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04609 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.644363:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835371b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04609 expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832159.644395:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d2c3919d900) 00010000:00010000:2.0:1788832159.644398:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788832159.644402:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031000, rc 0) 00000100:00100000:2.0:1788832159.644476:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+12:10503:x1875726202591360:12345-192.168.203.26@tcp:101:touch.500 Request processed in 3378us (3658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832159.644484:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 32 00000100:00100000:1.0:1788832159.648693:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832159.648795:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202591488 00000100:00100000:3.0:1788832159.648804:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202591488 00000100:00100000:3.0:1788832159.648855:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:3.0:1788832159.648863:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1875726202591488:12345-192.168.203.26@tcp:8:touch.500 00010000:00080000:3.0:1788832159.648898:0:8440:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp t0 exp 0000000000000000 cur 299 last 0 00000020:00000080:3.0:1788832159.648932:0:8440:0:(genops.c:1385:class_connect()) connect: client 352fff76-09db-42cd-818a-16e788a01abb, cookie 0x998c12b2835371bc 00002000:00100000:3.0:1788832159.648945:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 352fff76-09db-42cd-818a-16e788a01abb/ffff9d2b076ec800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788832159.648964:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788832159.649045:0:8440:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788832159.649074:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9d2b076ef800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788832159.649142:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+6:2392:x1875726202591488:12345-192.168.203.26@tcp:8:touch.500 Request processed in 277us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832159.649149:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:3.0:1788832159.657994:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832159.658117:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202591616 00000100:00100000:0.0:1788832159.658126:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202591616 00000100:00100000:0.0:1788832159.658199:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:0.0:1788832159.658210:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+6:0:x1875726202591616:12345-192.168.203.26@tcp:2:touch.500 00000100:00080000:2.0:1788832159.658432:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788832159.660765:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:1.0:1788832159.660777:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 352fff76-09db-42cd-818a-16e788a01abb 00000100:00100000:0.0:1788832159.660978:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+5:0:x1875726202591616:12345-192.168.203.26@tcp:2:touch.500 Request processed in 2764us (2987us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788832159.660988:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:1.0:1788832159.665166:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832159.665346:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202591872 00000100:00100000:2.0:1788832159.665356:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202591872 00000100:00100000:2.0:1788832159.665413:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:2.0:1788832159.665424:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+12:10503:x1875726202591872:12345-192.168.203.26@tcp:35:touch.500 00000100:00100000:2.0:1788832159.665777:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+13:10503:x1875726202591872:12345-192.168.203.26@tcp:35:touch.500 Request processed in 353us (617us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788832159.665785:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:1.0:1788832159.689881:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832159.689973:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202592000 00000100:00100000:3.0:1788832159.689984:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202592000 00000100:00100000:3.0:1788832159.690054:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:3.0:1788832159.690065:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+13:10504:x1875726202592000:12345-192.168.203.26@tcp:101:rm.0 00010000:00010000:3.0:1788832159.690091:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832159.690116:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3e00/0x998c12b2835371c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04610 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832159.690210:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b2835371ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832159.690225:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b2835371ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832159.690238:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b2835371ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832159.690298:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788832159.690302:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788832159.690340:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b2835371ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832159.690365:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3e00/0x998c12b2835371c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04610 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832159.690383:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b2835371ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04610 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832159.690391:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d2c3919dd00) 00010000:00010000:3.0:1788832159.690394:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788832159.690398:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d3000, rc 0) 00000100:00100000:3.0:1788832159.690563:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+14:10504:x1875726202592000:12345-192.168.203.26@tcp:101:rm.0 Request processed in 498us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832159.690571:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:0.0:1788832159.704716:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832159.705087:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202592256 00000100:00100000:1.0:1788832159.705099:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202592256 00000100:00100000:1.0:1788832159.705161:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:1.0:1788832159.705172:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+14:10504:x1875726202592256:12345-192.168.203.26@tcp:101:rm.0 00010000:00010000:1.0:1788832159.705192:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832159.705213:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfea00/0x998c12b2835371d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04617 expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832159.705319:0:8742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788832159.705462:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfea00/0x998c12b2835371d1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04617 expref: 16 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.705488:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c100ce100) 00010000:00010000:1.0:1788832159.705491:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788832159.705496:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfea00/0x998c12b2835371d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04617 expref: 16 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.705508:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfea00, rc 0) 00000100:00100000:1.0:1788832159.705583:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+15:10504:x1875726202592256:12345-192.168.203.26@tcp:101:rm.0 Request processed in 413us (878us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1788832159.705591:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:1.0:1788832159.709287:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832159.709868:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202592384 00000100:00100000:2.0:1788832159.709880:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202592384 00000100:00100000:2.0:1788832159.709992:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:2.0:1788832159.710003:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+15:10504:x1875726202592384:12345-192.168.203.26@tcp:37:rm.0 00000100:00100000:2.0:1788832159.714769:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+15:10504:x1875726202592384:12345-192.168.203.26@tcp:37:rm.0 Request processed in 4537us (5261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832159.714783:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:0.0:1788832159.720487:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832159.720673:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202592640 00000100:00100000:3.0:1788832159.720683:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202592640 00000100:00100000:3.0:1788832159.720755:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:3.0:1788832159.720766:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18f2a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+15:10504:x1875726202592640:12345-192.168.203.26@tcp:35:rm.0 00000100:00100000:3.0:1788832159.720994:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18f2a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+16:10504:x1875726202592640:12345-192.168.203.26@tcp:35:rm.0 Request processed in 229us (516us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788832159.721001:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:1.0:1788832159.725849:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832159.726242:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202592896 00000100:00100000:3.0:1788832159.726253:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202592896 00000100:00100000:3.0:1788832159.726317:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:3.0:1788832159.726327:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+16:10504:x1875726202592896:12345-192.168.203.26@tcp:101:rm.0 00010000:00010000:3.0:1788832159.726351:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832159.726371:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3e00/0x998c12b2835371df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0461e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832159.726482:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b2835371e6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832159.726497:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b2835371e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832159.726509:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b2835371e6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832159.726520:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788832159.726689:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3e00/0x998c12b2835371df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0461e expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832159.726709:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b2835371e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0461e expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832159.726739:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d2c3919dd00) 00010000:00010000:3.0:1788832159.726984:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788832159.726988:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2a00, rc 0) 00000100:00100000:3.0:1788832159.727066:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+18:10504:x1875726202592896:12345-192.168.203.26@tcp:101:rm.0 Request processed in 740us (1229us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788832159.727074:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:0.0:1788832159.733026:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832159.733117:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202593024 00000100:00100000:1.0:1788832159.733127:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202593024 00000100:00100000:1.0:1788832159.733189:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:1.0:1788832159.733199:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+18:10504:x1875726202593024:12345-192.168.203.26@tcp:41:rm.0 00000004:00000024:1.0:1788832159.733253:0:8742:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1788832159.733329:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+18:10504:x1875726202593024:12345-192.168.203.26@tcp:41:rm.0 Request processed in 130us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832159.733337:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:0.0:1788832159.737214:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832159.737873:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202593152 00000100:00100000:1.0:1788832159.737885:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202593152 00000100:00100000:1.0:1788832159.737952:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 37 00000100:00100000:1.0:1788832159.737966:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+18:10504:x1875726202593152:12345-192.168.203.26@tcp:101:rm.0 00010000:00010000:1.0:1788832159.737989:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832159.738011:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfea00/0x998c12b2835371f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04625 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738115:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b2835371fb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738130:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b2835371fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738145:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b2835371fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738158:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537202 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738165:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537202 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738174:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537202 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738274:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe400/0x998c12b283537209 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738285:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe400/0x998c12b283537209 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738292:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe400/0x998c12b283537209 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832159.738336:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788832159.738339:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788832159.738362:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe400/0x998c12b283537209 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738387:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe400/0x998c12b283537209 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738398:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b2835371fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738406:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b2835371fb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738413:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b2835371fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738419:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832159.738425:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b2835371fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738435:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b2835371fb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738446:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d2c3919dd00) 00010000:00010000:1.0:1788832159.738450:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832159.738457:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b2835371fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738465:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b2835371fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738477:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537202 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738486:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537202 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738500:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537202 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738506:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832159.738509:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537202 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738518:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537202 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738528:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9d2c3919d400) 00010000:00010000:1.0:1788832159.738531:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832159.738533:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537202 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738539:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537202 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738580:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfea00/0x998c12b2835371f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04625 expref: 20 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738596:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe400/0x998c12b283537209 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04625 expref: 19 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.738603:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d2c3919d900) 00010000:00010000:1.0:1788832159.738605:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832159.738610:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe400, rc 0) 00000100:00100000:1.0:1788832159.738985:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+19:10504:x1875726202593152:12345-192.168.203.26@tcp:101:rm.0 Request processed in 1023us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832159.739089:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 37 00000100:00100000:3.0:1788832159.743510:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832159.743820:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202593408 00000100:00100000:1.0:1788832159.743830:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202593408 00000100:00100000:1.0:1788832159.743893:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:1.0:1788832159.743904:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+19:10504:x1875726202593408:12345-192.168.203.26@tcp:36:rm.0 00010000:00010000:1.0:1788832159.743963:0:8742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788832159.743992:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe400/0x998c12b283537209 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04625 expref: 19 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.744011:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835371b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04609 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.744023:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d2c3919d900) 00010000:00010000:1.0:1788832159.744045:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b2835371ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04610 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.744054:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d2c3919dd00) 00010000:00010000:1.0:1788832159.744057:0:8742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788832159.744081:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfea00/0x998c12b283537210 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.744094:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfea00/0x998c12b283537210 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.744104:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfea00/0x998c12b283537210 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.744114:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537217 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.744134:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537217 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.744141:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537217 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.744445:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353721e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.744456:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353721e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.744464:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353721e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788832159.744966:0:8742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788832159.744976:0:8742:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 299785355147ns, next at 300785352987ns, rc = 0 00010000:00010000:1.0:1788832159.745023:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffc00/0x998c12b283537225 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.745044:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffc00/0x998c12b283537225 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.745053:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffc00/0x998c12b283537225 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.745060:0:8742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffc00/0x998c12b283537225 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.745066:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffc00/0x998c12b283537225 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.745085:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffc00/0x998c12b283537225 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.745144:0:8742:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788832159.745174:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353721e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.745180:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353721e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.745185:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353721e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.745190:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832159.745194:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353721e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.745201:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353721e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.745212:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d2c3919d900) 00010000:00010000:1.0:1788832159.745215:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788832159.745219:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353721e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.745224:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353721e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.745239:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfea00/0x998c12b283537210 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.745244:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfea00/0x998c12b283537210 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.745255:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfea00/0x998c12b283537210 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.745260:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfea00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832159.745262:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfea00/0x998c12b283537210 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.745268:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfea00/0x998c12b283537210 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.745276:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d2c3919dd00) 00010000:00010000:1.0:1788832159.745278:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832159.745280:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfea00/0x998c12b283537210 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.745285:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfea00/0x998c12b283537210 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788832159.745294:0:8742:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007caea2af reply state 00000000edbdec9c transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537217 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.745305:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537217 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.745310:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9d2c3919d400) 00010000:00010000:1.0:1788832159.745312:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788832159.745315:0:8742:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788832159.745405:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+18:10504:x1875726202593408:12345-192.168.203.26@tcp:36:rm.0 Request processed in 1500us (1900us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788832159.745414:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 38 00010000:00010000:3.0:1788832159.748973:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832159.748990:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffc00/0x998c12b283537225 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832159.749003:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cffc00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:3.0:1788832159.749008:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffc00/0x998c12b283537225 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832159.749018:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffc00/0x998c12b283537225 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832159.749047:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d2c3919d900) 00010000:00010000:3.0:1788832159.749051:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788832159.749056:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffc00/0x998c12b283537225 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832159.749063:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffc00/0x998c12b283537225 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832159.749215:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832159.749217:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832159.749219:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832159.749348:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832159.749469:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202593664 00000100:00100000:3.0:1788832159.749480:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202593664 00000100:00100000:3.0:1788832159.749549:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:3.0:1788832159.749559:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+18:10504:x1875726202593664:12345-192.168.203.26@tcp:35:rm.0 00000100:00100000:3.0:1788832159.749823:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+19:10504:x1875726202593664:12345-192.168.203.26@tcp:35:rm.0 Request processed in 264us (478us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788832159.749832:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:0.0:1788832159.753121:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832159.753208:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202593920 00000100:00100000:1.0:1788832159.753217:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202593920 00000100:00100000:1.0:1788832159.753277:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:1.0:1788832159.753288:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+19:10504:x1875726202593920:12345-192.168.203.26@tcp:36:rm.0 00010000:00010000:1.0:1788832159.753354:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788832159.753383:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b2835371e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0461e expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.753403:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8200/0x998c12b283537184 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045fb expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.753415:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d2c3919dd00) 00010000:00010000:1.0:1788832159.753431:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537145 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045ed expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.753442:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c100ce100) 00010000:00010000:1.0:1788832159.753449:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788832159.753473:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353722c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.753485:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353722c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.753495:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353722c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.753508:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537233 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.753515:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537233 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.753535:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537233 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.753674:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353723a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.753684:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353723a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.753691:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353723a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832159.753902:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788832159.753916:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353723a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.753923:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353723a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.753930:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353723a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.753936:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfee00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832159.753940:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353723a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.753947:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353723a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.753956:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d2b073ae400) 00010000:00010000:1.0:1788832159.753959:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788832159.753970:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353723a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.753976:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353723a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.753996:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353722c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.754002:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353722c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.754008:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353722c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.754013:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832159.754015:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353722c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.754021:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353722c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.754040:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2b073ae300) 00010000:00010000:1.0:1788832159.754043:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832159.754046:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353722c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.754051:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353722c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788832159.754062:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f8af3f1 reply state 000000007570092d transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537233 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.754083:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537233 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832159.754089:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d2b073aed00) 00010000:00010000:1.0:1788832159.754092:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788832159.754094:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788832159.754170:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+18:10504:x1875726202593920:12345-192.168.203.26@tcp:36:rm.0 Request processed in 883us (1056us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788832159.754178:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 39 00010000:00010000:2.0:1788832160.214898:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832160.473073:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788832160.473101:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218399360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832160.473203:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832160.473269:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218399360 00000100:00100000:2.0:1788832160.473277:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218399360 00000100:00100000:2.0:1788832160.473325:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788832160.473335:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218399360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788832160.473370:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788832160.473416:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218399360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832160.473422:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788832160.473466:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218399360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788832160.985364:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788832160.985386:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218399488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788832160.985454:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832160.985558:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218399488 00000100:00100000:0.0:1788832160.985566:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218399488 00000100:00100000:0.0:1788832160.985639:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788832160.985649:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218399488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788832160.985684:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788832160.985742:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218399488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832160.985749:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788832160.985966:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218399488:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788832161.241485:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832161.495406:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218399616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832161.495484:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832161.497295:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218399616 00000100:00100000:0.0:1788832161.497309:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218399616 00000100:00100000:0.0:1788832161.497381:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788832161.497401:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218399616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788832161.497436:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788832161.497481:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788832161.498327:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218399872:0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.498371:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832161.498407:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218400384:0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.498423:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832161.498440:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218400896:0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.498456:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832161.498472:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788832161.498477:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218400000:0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.498494:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832161.498505:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218400512:0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.498524:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832161.498537:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218401024:0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.498552:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832161.499856:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218399872 00000100:00100000:3.0:1788832161.499868:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218399872 00000100:00100000:3.0:1788832161.499912:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218400384 00000100:00100000:3.0:1788832161.499915:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218400384 00000100:00100000:3.0:1788832161.499935:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218400896 00000100:00100000:3.0:1788832161.499937:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218400896 00000100:00100000:3.0:1788832161.499947:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218400000 00000100:00100000:3.0:1788832161.499949:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218400000 00000100:00100000:3.0:1788832161.499963:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788832161.499971:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218399872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.500056:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218399872:12345-0@lo:400:kworker.0 Request processed in 85us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832161.500063:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788832161.500080:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788832161.500085:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218400384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.500109:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218400384:12345-0@lo:400:kworker.0 Request processed in 24us (1684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832161.500114:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788832161.500122:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788832161.500127:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218400896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.500147:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218400896:12345-0@lo:400:kworker.0 Request processed in 20us (1690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832161.500152:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788832161.500160:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788832161.500165:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218400000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.500184:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218400000:12345-0@lo:400:kworker.0 Request processed in 19us (1690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832161.500189:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788832161.500214:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218400512 00000100:00100000:3.0:1788832161.500222:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218400512 00000100:00100000:3.0:1788832161.500245:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218401024 00000100:00100000:3.0:1788832161.500248:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218401024 00000100:00100000:3.0:1788832161.500263:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788832161.500268:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218400512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.500295:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218400512:12345-0@lo:400:kworker.0 Request processed in 27us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832161.500301:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788832161.500311:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788832161.500316:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218401024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.500336:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218401024:12345-0@lo:400:kworker.0 Request processed in 21us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832161.500341:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788832161.500363:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788832161.500367:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788832161.500369:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788832161.500395:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218400000:0@lo:400:kworker.0 00010000:00080000:3.0:1788832161.500408:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc04700 x1875726218400512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832161.500418:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218400512:0@lo:400:kworker.0 00010000:00080000:3.0:1788832161.500427:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcbb100 x1875726218401024/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832161.500435:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218401024:0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.500444:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218399872:0@lo:400:kworker.0 00010000:00080000:3.0:1788832161.500452:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc04a80 x1875726218400384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832161.500466:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218400384:0@lo:400:kworker.0 00010000:00080000:3.0:1788832161.500476:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcbb480 x1875726218400896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832161.500484:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218400896:0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.506405:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218399744:0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.506483:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832161.506533:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1875726218400256:0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.506561:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832161.506583:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1875726218400768:0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.506605:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832161.506673:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788832161.506680:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218400128:0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.506709:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832161.506737:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218400640:0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.506761:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832161.509010:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218399744 00000100:00100000:3.0:1788832161.509032:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218399744 00000100:00100000:3.0:1788832161.509107:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788832161.509117:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3652:x1875726218399744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.509201:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3652:x1875726218399744:12345-0@lo:400:kworker.0 Request processed in 85us (2718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832161.509208:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788832161.509246:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218400256 00000100:00100000:3.0:1788832161.509259:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218400256 00000100:00100000:3.0:1788832161.509287:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218400768 00000100:00100000:3.0:1788832161.509289:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218400768 00000100:00100000:3.0:1788832161.509305:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788832161.509310:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875726218400256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.509340:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875726218400256:12345-0@lo:400:kworker.0 Request processed in 31us (2779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832161.509346:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788832161.509356:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788832161.509361:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875726218400768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.509381:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875726218400768:12345-0@lo:400:kworker.0 Request processed in 21us (2776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832161.509386:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:3.0:1788832161.509415:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832161.509446:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218399744:0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.509460:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1875726218400256:0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.509469:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1875726218400768:0@lo:400:kworker.0 00000100:00100000:0.0:1788832161.510204:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218399616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 12800us (14714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832161.510217:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788832161.510251:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218400640 00000100:00100000:0.0:1788832161.510257:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218400640 00000100:00100000:0.0:1788832161.510305:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788832161.510313:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218400640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832161.510364:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218400640:12345-0@lo:400:kworker.0 Request processed in 52us (3602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832161.510370:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1788832161.510414:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc05180 x1875726218400640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832161.510428:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218400640:0@lo:400:kworker.0 00000100:00080000:3.0:1788832161.512509:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788832161.513283:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218400128 00000100:00100000:3.0:1788832161.513295:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218400128 00000100:00100000:3.0:1788832161.513369:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788832161.513379:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218400128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832161.513487:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218400128:12345-0@lo:400:kworker.0 Request processed in 110us (6776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832161.513496:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788832161.513521:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218400128:0@lo:400:kworker.0 00010000:00080000:2.0:1788832161.513760:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b077b9c00 x1875726218399616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832161.513781:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218399616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832162.007945:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218401152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788832162.008045:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832162.008104:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218401152 00000100:00100000:0.0:1788832162.008113:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218401152 00000100:00100000:0.0:1788832162.008172:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788832162.008182:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218401152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788832162.008204:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832162.008268:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218401152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832162.008278:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1788832162.008332:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b077baa00 x1875726218401152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832162.008367:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218401152:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788832162.264085:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832162.519004:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218401280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832162.519085:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832162.519227:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218401280 00000100:00100000:0.0:1788832162.519235:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218401280 00000100:00100000:0.0:1788832162.519297:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788832162.519306:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218401280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788832162.519334:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832162.519387:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218401280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832162.519395:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:2.0:1788832162.519535:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b077baa00 x1875726218401280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832162.519554:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218401280:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1788832163.030784:0:8919:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 303071160720ns, next at 304071158339ns, rc = 0 00000100:00100000:2.0:1788832163.033947:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788832163.033977:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218401408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832163.034062:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832163.034187:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218401408 00000100:00100000:0.0:1788832163.034195:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218401408 00000100:00100000:0.0:1788832163.034264:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788832163.034276:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218401408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788832163.034309:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832163.034358:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218401408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832163.034366:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1788832163.034413:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b077bb800 x1875726218401408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832179 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832163.034434:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218401408:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788832163.034733:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788832163.286793:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832163.541345:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832163.541396:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832163.541433:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202594432 00000100:00100000:0.0:1788832163.541451:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202594432 00000100:00100000:0.0:1788832163.541516:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 78 00000100:00100000:0.0:1788832163.541527:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202594432:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832163.541597:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202594432:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 72us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832163.541603:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 78 00000100:00100000:3.0:1788832163.542039:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202594176 00000100:00100000:3.0:1788832163.542045:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202594176 00000100:00100000:3.0:1788832163.542147:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 199 00000100:00100000:3.0:1788832163.542157:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+18:2393:x1875726202594176:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832163.542205:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+18:2393:x1875726202594176:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 50us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832163.542213:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 199 00000100:00080000:2.0:1788832163.545166:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788832163.545178:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788832163.551051:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832163.551124:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202594688 00000100:00100000:3.0:1788832163.551133:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202594688 00000100:00100000:3.0:1788832163.552335:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 200 00000100:00100000:3.0:1788832163.552350:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202594688:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832163.552446:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202594688:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 100us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832163.552454:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 200 00000100:00100000:0.0:1788832163.554038:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832163.554078:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832163.554099:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832163.554125:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202594304 00000100:00100000:0.0:1788832163.554134:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202594304 00000100:00100000:3.0:1788832163.554817:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202594048 00000100:00100000:3.0:1788832163.554825:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202594048 00000100:00100000:3.0:1788832163.556170:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 333 00000100:00100000:3.0:1788832163.556189:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2394:x1875726202594048:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832163.556278:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2394:x1875726202594048:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 96us (2246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832163.556286:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 333 00000100:00100000:3.0:1788832163.556330:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202594560 00000100:00100000:3.0:1788832163.556337:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202594560 00000100:00080000:2.0:1788832163.558770:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788832163.558780:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788832163.560427:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 201 00000100:00100000:0.0:1788832163.560441:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2394:x1875726202594304:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832163.560519:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2394:x1875726202594304:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 82us (6439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832163.560527:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 201 00000100:00100000:3.0:1788832163.562313:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 202 00000100:00100000:3.0:1788832163.562327:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2394:x1875726202594560:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832163.562402:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2394:x1875726202594560:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 77us (8299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832163.562409:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 202 00000001:02000400:1.0:1788832163.668735:0:13685:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1788832164.314352:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788832164.811287:0:13733:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffdb55c8a0 20000000:00000080:0.0:1788832164.811482:0:13733:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d2c3e759000 uarg=0000000000000000 20000000:01000000:0.0:1788832164.811524:0:13733:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788832164.811530:0:13733:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788832164.811535:0:13733:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788832164.812036:0:13734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788832164.812251:0:13733:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788832164.822135:0:13733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788832164.822187:0:13733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788832164.822205:0:13733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788832164.822229:0:13733:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788832164.822264:0:13733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d2c1fe0cc00/0x998c12b283537241 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832164.822285:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c390f2e00/0x998c12b2835370ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045d8 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832164.822293:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c00030a00/0x998c12b2835370d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045df expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832164.822300:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c390f2400/0x998c12b2835370e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835370dc expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832164.822306:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c390f2800/0x998c12b2835370f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835370ea expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832164.822312:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c00031c00/0x998c12b2835370ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835370f8 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832164.822318:0:13733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c36db9800/0x998c12b28353710d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283537106 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832164.822324:0:13733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d2c1fe0cc00/0x998c12b283537241 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832164.822361:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c36db9800/0x998c12b28353710d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283537106 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832164.822377:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c36db9800/0x998c12b28353710d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283537106 expref: 23 pid: 6517 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832164.822403:0:13733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077b8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1875726218401536:0@lo:104: 00000100:00100000:0.0:1788832164.822478:0:13733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832164.822546:0:6509:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788832164.822570:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218401536 00000100:00100000:2.0:1788832164.822580:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218401536 00000100:00100000:2.0:1788832164.822685:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788832164.822695:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0677a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+3:13733:x1875726218401536:12345-0@lo:104: 00010000:00010000:2.0:1788832164.822708:0:6509:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b283537106 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b28353710d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.822765:0:6509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788832164.822771:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0677a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e55f0905-9d39-4464-9830-326b420fb582+3:13733:x1875726218401536:12345-0@lo:104: Request processed in 78us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832164.822779:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1788832164.822798:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832164.822806:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b283537106 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b28353710d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832164.822815:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d3600 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832164.822820:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b283537106 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b28353710d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832164.822829:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b283537106 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b28353710d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832164.822837:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b283537106 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b28353710d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832164.822843:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788832164.822877:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b283537106 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353710d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832164.822883:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832164.822902:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b283537106 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353710d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832164.822910:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b283537106 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353710d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832164.822924:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832164.822926:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832164.822934:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832164.822941:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218401664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832164.822971:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832164.823036:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c00031c00/0x998c12b2835370ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b2835370f8 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832164.823046:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c00031c00/0x998c12b2835370ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b2835370f8 expref: 23 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832164.823052:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218401664 00000100:00100000:0.0:1788832164.823057:0:13733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077b9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1875726218401792:0@lo:104: 00000100:00100000:3.0:1788832164.823058:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218401664 00010000:00010000:3.0:1788832164.823085:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c36db9800/0x998c12b28353710d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283537106 expref: 24 pid: 6517 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832164.823092:0:13733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832164.823121:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c390f2800/0x998c12b2835370f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b2835370ea expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832164.823130:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00010000:00010000:0.0:1788832164.823132:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c390f2800/0x998c12b2835370f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b2835370ea expref: 24 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832164.823142:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+24:3654:x1875726218401664:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788832164.823145:0:13733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077b9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1875726218401920:0@lo:104: 00010000:00010000:3.0:1788832164.823157:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832164.823164:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c36db9800/0x998c12b28353710d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283537106 expref: 24 pid: 6517 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832164.823173:0:13733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788832164.823178:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c36db9800/0x998c12b28353710d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283537106 expref: 24 pid: 6517 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832164.823313:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c390f2400/0x998c12b2835370e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b2835370dc expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832164.823322:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d2c390f2400/0x998c12b2835370e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b2835370dc expref: 24 pid: 6518 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832164.823331:0:13733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070b8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1875726218402048:0@lo:104: 00000100:00100000:0.0:1788832164.823351:0:13733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832164.823367:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c00030a00/0x998c12b2835370d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045df expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832164.823378:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2c00030a00/0x998c12b2835370d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045df expref: 12 pid: 6519 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832164.823480:0:13733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070bad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1875726218402176:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788832164.823592:0:13733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c390f2e00/0x998c12b2835370ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045d8 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832164.823602:0:13733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2c390f2e00/0x998c12b2835370ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045d8 expref: 12 pid: 6517 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832164.823610:0:13733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070bb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1875726218402304:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788832164.823645:0:13733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c07c4a3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788832164.823723:0:13733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c36db9800/0x998c12b28353710d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283537106 expref: 24 pid: 6517 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832164.823736:0:13733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077b8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1875726218401536:0@lo:104: 00000100:00100000:2.0:1788832164.825347:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218401792 00000100:00100000:2.0:1788832164.825358:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218401792 00000100:00100000:2.0:1788832164.825393:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218401920 00000100:00100000:2.0:1788832164.825395:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218401920 00000100:00100000:2.0:1788832164.825404:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218402048 00000100:00100000:2.0:1788832164.825406:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218402048 00000100:00100000:2.0:1788832164.825419:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788832164.825427:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+5:13733:x1875726218401792:12345-0@lo:104: 00010000:00010000:2.0:1788832164.825441:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b2835370f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b2835370ff expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.825541:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788832164.825651:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+5:13733:x1875726218401792:12345-0@lo:104: Request processed in 121us (2458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832164.825660:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788832164.825678:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788832164.825684:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+4:13733:x1875726218401920:12345-0@lo:104: 00010000:00010000:2.0:1788832164.825692:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b2835370ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b2835370f1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.825798:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788832164.825804:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+4:13733:x1875726218401920:12345-0@lo:104: Request processed in 120us (2632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832164.825810:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788832164.825822:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788832164.825827:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+3:13733:x1875726218402048:12345-0@lo:104: 00010000:00010000:2.0:1788832164.825834:0:6508:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835370dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b2835370e3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.825936:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788832164.825942:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e55f0905-9d39-4464-9830-326b420fb582+3:13733:x1875726218402048:12345-0@lo:104: Request processed in 115us (2590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832164.825949:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1788832164.825966:0:13191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788832164.825972:0:13191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b2835370f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b2835370ff expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.825989:0:13191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c36db9200 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832164.826002:0:13191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b2835370f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b2835370ff expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.826011:0:13191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b2835370f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b2835370ff expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832164.826017:0:13191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b2835370f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b2835370ff expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832164.826022:0:13191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788832164.826058:0:13191:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b2835370f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835370ff expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.826064:0:13191:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832164.826083:0:13191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b2835370f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835370ff expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.826089:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9200/0x998c12b2835370f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835370ff expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.826101:0:13191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788832164.826105:0:13191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b2835370ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b2835370f1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.826111:0:13191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c390f2600 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832164.826113:0:13191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b2835370ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b2835370f1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.826131:0:13191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b2835370ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b2835370f1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832164.826137:0:13191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b2835370ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b2835370f1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832164.826142:0:13191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788832164.826156:0:13191:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b2835370ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835370f1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.826161:0:13191:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832164.826167:0:13191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b2835370ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835370f1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.826174:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2600/0x998c12b2835370ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835370f1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.826183:0:13191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832164.826186:0:13191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835370dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b2835370e3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.826192:0:13191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2000 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832164.826194:0:13191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835370dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b2835370e3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.826201:0:13191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835370dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b2835370e3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832164.826208:0:13191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835370dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b2835370e3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832164.826219:0:13191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788832164.826234:0:13191:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835370dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835370e3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.826239:0:13191:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832164.826255:0:13191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835370dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835370e3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.826261:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835370dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835370e3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.826274:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832164.826276:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832164.826277:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832164.826283:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832164.826297:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218402432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832164.826333:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832164.826371:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832164.826377:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218402560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832164.826397:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832164.826423:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218402432 00000100:00100000:2.0:1788832164.826429:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218402432 00010000:00010000:2.0:1788832164.826445:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c00031c00/0x998c12b2835370ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b2835370f8 expref: 24 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832164.826465:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218402560 00000100:00100000:2.0:1788832164.826467:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218402560 00010000:00010000:2.0:1788832164.826478:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c390f2800/0x998c12b2835370f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b2835370ea expref: 25 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832164.826507:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788832164.826525:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e55f0905-9d39-4464-9830-326b420fb582+25:3651:x1875726218402432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788832164.826535:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832164.826541:0:7466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c00031c00/0x998c12b2835370ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b2835370f8 expref: 25 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.826562:0:7466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c00031c00/0x998c12b2835370ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b2835370f8 expref: 25 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.826580:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832164.826614:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e55f0905-9d39-4464-9830-326b420fb582+25:3651:x1875726218402432:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832164.826636:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788832164.826651:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788832164.826657:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218402560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788832164.826664:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832164.826668:0:7466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c390f2800/0x998c12b2835370f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b2835370ea expref: 24 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.826676:0:7466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c390f2800/0x998c12b2835370f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b2835370ea expref: 24 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.826686:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832164.826707:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218402560:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832164.826873:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788832164.826904:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218402688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832164.826934:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788832164.826969:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832164.826985:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218402688 00000100:00100000:2.0:1788832164.826989:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218402688 00010000:00010000:2.0:1788832164.827013:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c390f2400/0x998c12b2835370e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b2835370dc expref: 24 pid: 6518 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832164.827031:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788832164.827037:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e55f0905-9d39-4464-9830-326b420fb582+24:3653:x1875726218402688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788832164.827044:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832164.827048:0:7466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c390f2400/0x998c12b2835370e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b2835370dc expref: 24 pid: 6518 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.827057:0:7466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c390f2400/0x998c12b2835370e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b2835370dc expref: 24 pid: 6518 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.827067:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832164.827092:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e55f0905-9d39-4464-9830-326b420fb582+24:3653:x1875726218402688:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832164.827098:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788832164.827130:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218402688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788832164.827254:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218402560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788832164.827263:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218402432:0@lo:103:ldlm_bl.0 00000004:00080000:1.0:1788832164.827360:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788832164.827388:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1788832164.827396:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1788832164.827424:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537199 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827432:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537199 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827438:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537199 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827443:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c36db8400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832164.827454:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537199 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827462:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537199 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827475:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9d2c3919d400) 00010000:00010000:1.0:1788832164.827477:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832164.827482:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537199 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827487:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c36db8400/0x998c12b283537199 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827502:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b2835371ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827507:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b2835371ae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827511:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b2835371ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827516:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0d200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832164.827519:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b2835371ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827524:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b2835371ae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827531:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d2c3919d900) 00010000:00010000:1.0:1788832164.827533:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832164.827542:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b2835371ae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827557:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b2835371ae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827575:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537217 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827581:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537217 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827586:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537217 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827591:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832164.827593:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537217 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827599:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537217 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827607:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xff62f1ab (ffff9d2c3919d400) 00010000:00010000:1.0:1788832164.827609:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832164.827611:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537217 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827617:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537217 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xff62f1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827653:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537233 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827673:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537233 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827679:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537233 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827683:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832164.827686:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537233 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827692:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537233 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827701:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d2b073aed00) 00010000:00010000:1.0:1788832164.827704:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832164.827707:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537233 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.827712:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537233 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832164.827884:0:13733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c00031c00/0x998c12b2835370ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b2835370f8 expref: 23 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832164.827897:0:13733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077b9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1875726218401792:0@lo:104: 00010000:00010000:0.0:1788832164.827909:0:13733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c390f2800/0x998c12b2835370f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b2835370ea expref: 22 pid: 6519 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832164.827917:0:13733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077b9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1875726218401920:0@lo:104: 00010000:00010000:0.0:1788832164.827927:0:13733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c390f2400/0x998c12b2835370e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b2835370dc expref: 21 pid: 6518 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832164.827934:0:13733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070b8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1875726218402048:0@lo:104: 00000100:00100000:0.0:1788832164.828564:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218402816:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788832164.828616:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832164.828743:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218402816 00000100:00100000:1.0:1788832164.828748:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218402816 00000100:00100000:1.0:1788832164.828786:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788832164.828795:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218402816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788832164.828817:0:10097:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1788832164.828847:0:10097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f69a0, atime: 0x6a9f69a0, ctime: 0x6a9f69a0, blocks: 0x0 00010000:00010000:1.0:1788832164.828853:0:10097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008649b612/0x998c12b283537248 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.828878:0:10097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=304s v=(0 0) 00010000:00010000:1.0:1788832164.828883:0:10097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832164.828890:0:10097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008649b612/0x998c12b283537248 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.828905:0:10097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008649b612/0x998c12b283537248 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.828914:0:10097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008649b612/0x998c12b283537248 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.828920:0:10097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008649b612/0x998c12b283537248 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.828936:0:10097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832164.829122:0:13191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832164.829129:0:13191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008649b612/0x998c12b283537248 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.829136:0:13191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cffe00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832164.829140:0:13191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008649b612/0x998c12b283537248 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.829159:0:13191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008649b612/0x998c12b283537248 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.829174:0:13191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008649b612/0x998c12b283537248 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.829181:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008649b612/0x998c12b283537248 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.829198:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832164.829199:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832164.829201:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832164.829275:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3654:x1875726218402816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 479us (656us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788832164.829282:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788832164.829296:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832164.829419:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+20:3654:x1875726218401664:12345-0@lo:103:ldlm_bl.0 Request processed in 6280us (6446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832164.829427:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788832164.829558:0:13733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070bad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1875726218402176:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788832164.829568:0:13733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070bb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13733:1875726218402304:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832164.829596:0:13733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d2c1fe0cc00/0x998c12b283537241 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788832164.829864:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d2c182ab100/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788832164.829871:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218402816:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788832164.829884:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218401664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788832164.830518:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832164.830597:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832164.830679:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202594816 00000100:00100000:2.0:1788832164.830685:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202594816 00010000:00010000:2.0:1788832164.830721:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c00030a00/0x998c12b2835370d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045df expref: 13 pid: 6519 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832164.830748:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202594944 00000100:00100000:2.0:1788832164.830752:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202594944 00010000:00010000:2.0:1788832164.830763:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c390f2e00/0x998c12b2835370ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045d8 expref: 14 pid: 6517 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832164.830764:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:1.0:1788832164.830773:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:229a6744-cc0e-4765-812a-1d39bc7df2da+14:2394:x1875726202594816:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832164.830784:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832164.830790:0:7466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c00030a00/0x998c12b2835370d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045df expref: 14 pid: 6519 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832164.830795:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 51 00010000:00010000:1.0:1788832164.830800:0:7466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c00030a00/0x998c12b2835370d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045df expref: 14 pid: 6519 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832164.830801:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:229a6744-cc0e-4765-812a-1d39bc7df2da+14:2394:x1875726202594944:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832164.830809:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832164.830813:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c390f2e00/0x998c12b2835370ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045d8 expref: 14 pid: 6517 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.830819:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c00030a00/0x998c12b2835370d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045df expref: 14 pid: 6519 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.830820:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c390f2e00/0x998c12b2835370ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045d8 expref: 14 pid: 6517 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.830829:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c390f2e00/0x998c12b2835370ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045d8 expref: 13 pid: 6517 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.830834:0:7466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d2c1fe0cc00/0x998c12b283537241 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.830906:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c1fe0cc00/0x998c12b283537241 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832164.831509:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832164.831576:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:229a6744-cc0e-4765-812a-1d39bc7df2da+12:2394:x1875726202594944:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 773us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832164.831584:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 51 00010000:00010000:1.0:1788832164.831746:0:7466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c1fe0cc00/0x998c12b283537241 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.831756:0:7466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c1fe0cc00/0x998c12b283537241 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.831764:0:7466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d2c1fe0cc00/0x998c12b283537241 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.831774:0:7466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d2c1fe0cc00/0x998c12b283537241 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.831780:0:7466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0cc00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:1.0:1788832164.831784:0:7466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d2c1fe0cc00/0x998c12b283537241 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.831792:0:7466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d2c1fe0cc00/0x998c12b283537241 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.831805:0:7466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d2c1fe0cc00/0x998c12b283537241 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832164.831826:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832164.831959:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:229a6744-cc0e-4765-812a-1d39bc7df2da+11:2394:x1875726202594816:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 1186us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832164.831967:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 50 00010000:00010000:0.0:1788832164.832828:0:13733:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d2c1fe0cc00/0x998c12b283537241 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832164.832904:0:13733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d2c1fe0cc00/0x998c12b283537241 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832164.832913:0:13733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c1fe0cc00/0x998c12b283537241 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832165.335958:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832165.595190:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218402944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788832165.595262:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832165.595355:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218402944 00000100:00100000:3.0:1788832165.595363:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218402944 00000100:00100000:3.0:1788832165.595422:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788832165.595432:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218402944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788832165.595466:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788832165.597029:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218402944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1592us (1760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832165.597041:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000020:00000080:2.0:1788832165.599504:0:13782:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa25ed270 20000000:00000080:2.0:1788832165.599523:0:13782:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d2b0677a400 uarg=0000000000000000 20000000:01000000:2.0:1788832165.599566:0:13782:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788832165.599572:0:13782:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788832165.599577:0:13782:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000100:00100000:1.0:1788832165.600529:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218402944:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788832165.601006:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1788832165.601249:0:13782:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1788832165.601349:0:13782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1788832165.601379:0:13782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1788832165.601471:0:13782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1788832165.601487:0:13782:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788832165.601524:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d2c00030c00/0x998c12b28353724f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832165.601542:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c00030c00/0x998c12b28353724f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832165.601553:0:13782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c00030c00/0x998c12b28353724f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832165.601560:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c00030c00/0x998c12b28353724f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832165.601568:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d2c00030c00/0x998c12b28353724f lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832165.601577:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d2c00030c00/0x998c12b28353724f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832165.602357:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030c00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832165.602370:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d2c00030c00/0x998c12b28353724f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832165.602382:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d2c00030c00/0x998c12b28353724f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832165.602478:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d2c00030c00/0x998c12b28353724f lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832165.602487:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d2c00030c00/0x998c12b28353724f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832165.602494:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c00030c00/0x998c12b28353724f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832166.035437:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832166.037090:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202595072 00000100:00100000:0.0:1788832166.037104:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202595072 00000100:00100000:0.0:1788832166.037177:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 334 00000100:00100000:0.0:1788832166.037187:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+11:6168:x1875726202595072:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832166.037204:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832166.037226:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c1fe0de00/0x998c12b283537256 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0462c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832166.037255:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c1fe0de00/0x998c12b283537256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0462c expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832166.037268:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c1fe0de00/0x998c12b283537256 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0462c expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832166.037296:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0de00, rc 0) 00000100:00100000:0.0:1788832166.037367:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+12:6168:x1875726202595072:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 181us (1939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832166.037382:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 334 00000100:00100000:3.0:1788832166.040604:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832166.040739:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202595200 00000100:00100000:2.0:1788832166.040748:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202595200 00000100:00100000:2.0:1788832166.040843:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 335 00000100:00100000:2.0:1788832166.040852:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+12:6168:x1875726202595200:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832166.040996:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+12:6168:x1875726202595200:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 136us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832166.041003:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 335 00000100:00100000:3.0:1788832166.042960:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832166.043066:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202595328 00000100:00100000:0.0:1788832166.043077:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202595328 00000100:00100000:0.0:1788832166.043130:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 336 00000100:00100000:0.0:1788832166.043139:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+12:6168:x1875726202595328:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832166.043285:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+12:6168:x1875726202595328:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 146us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832166.043293:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 336 00000100:00100000:3.0:1788832166.049911:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832166.050037:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202595456 00000100:00100000:0.0:1788832166.050048:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202595456 00000100:00100000:0.0:1788832166.050106:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 337 00000100:00100000:0.0:1788832166.050115:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+12:10787:x1875726202595456:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788832166.050272:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+12:10787:x1875726202595456:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 157us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832166.050279:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 337 00000100:00100000:1.0:1788832166.066488:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832166.066604:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202595584 00000100:00100000:2.0:1788832166.066614:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202595584 00000100:00100000:2.0:1788832166.066700:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 338 00000100:00100000:2.0:1788832166.066719:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+12:10787:x1875726202595584:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788832166.066869:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+12:10787:x1875726202595584:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 150us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832166.066877:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 338 00000100:00100000:2.0:1788832166.073938:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832166.074397:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202595712 00000100:00100000:3.0:1788832166.074408:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202595712 00000100:00100000:3.0:1788832166.074506:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 339 00000100:00100000:3.0:1788832166.074516:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+12:6168:x1875726202595712:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832166.074532:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832166.074549:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c421d2c00/0x998c12b28353725d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04633 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832166.074575:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d2c00/0x998c12b28353725d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04633 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832166.074605:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c421d2c00/0x998c12b28353725d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04633 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832166.074615:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2c00, rc 0) 00000100:00100000:3.0:1788832166.074799:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:6168:x1875726202595712:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 282us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832166.074806:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 339 00000100:00100000:3.0:1788832166.083104:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832166.083959:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202595840 00000100:00100000:0.0:1788832166.083972:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202595840 00000100:00100000:0.0:1788832166.084052:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 340 00000100:00100000:0.0:1788832166.084062:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:6168:x1875726202595840:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832166.084277:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:6168:x1875726202595840:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 216us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832166.084302:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 340 00000100:00100000:1.0:1788832166.092084:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832166.092175:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202595968 00000100:00100000:3.0:1788832166.092188:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202595968 00000100:00100000:3.0:1788832166.092255:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 341 00000100:00100000:3.0:1788832166.092265:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:6168:x1875726202595968:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832166.092445:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:6168:x1875726202595968:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 180us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832166.092460:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 341 00000100:00100000:3.0:1788832166.096148:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832166.096258:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202596096 00000100:00100000:2.0:1788832166.096269:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202596096 00000100:00100000:2.0:1788832166.096326:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 342 00000100:00100000:2.0:1788832166.096336:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:10790:x1875726202596096:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788832166.096487:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:10790:x1875726202596096:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 152us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832166.096494:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 342 00000100:00100000:2.0:1788832166.103083:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218403072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788832166.103172:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832166.103304:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218403072 00000100:00100000:0.0:1788832166.103313:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218403072 00000100:00100000:0.0:1788832166.103365:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788832166.103375:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218403072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788832166.103407:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788832166.103462:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218403072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832166.103469:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788832166.103606:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218403072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788832166.114931:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832166.115050:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202596224 00000100:00100000:0.0:1788832166.115061:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202596224 00000100:00100000:0.0:1788832166.115120:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 343 00000100:00100000:0.0:1788832166.115130:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:10790:x1875726202596224:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788832166.115293:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:10790:x1875726202596224:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 163us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832166.115300:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 343 00010000:00010000:2.0:1788832166.358912:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832166.615088:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788832166.615140:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832166.616052:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218403328:0@lo:400:kworker.0 00000100:00100000:2.0:1788832166.616126:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832166.616507:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218403328 00000100:00100000:0.0:1788832166.616515:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218403328 00000100:00100000:0.0:1788832166.616572:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788832166.616582:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+20:3653:x1875726218403328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832166.616670:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+20:3653:x1875726218403328:12345-0@lo:400:kworker.0 Request processed in 89us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832166.616678:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788832166.616776:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218403328:0@lo:400:kworker.0 00000100:00100000:1.0:1788832166.623674:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218403200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832166.623754:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832166.623935:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218403200 00000100:00100000:0.0:1788832166.623944:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218403200 00000100:00100000:0.0:1788832166.624039:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788832166.624050:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218403200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788832166.624080:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788832166.624256:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788832166.624425:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218403200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 376us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832166.624433:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:1.0:1788832166.624523:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b070b8a80 x1875726218403200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832166.624546:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218403200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832166.627534:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218403840:0@lo:400:kworker.0 00000100:00100000:1.0:1788832166.627664:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832166.627704:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1875726218404352:0@lo:400:kworker.0 00000100:00100000:1.0:1788832166.627725:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832166.627749:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788832166.627754:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218403712:0@lo:400:kworker.0 00000100:00100000:1.0:1788832166.627780:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832166.627816:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218404224:0@lo:400:kworker.0 00000100:00100000:1.0:1788832166.627841:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832166.627874:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218403712 00000100:00100000:1.0:1788832166.627884:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218403712 00000100:00100000:1.0:1788832166.627939:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788832166.627950:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218403712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832166.628024:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218403712:12345-0@lo:400:kworker.0 Request processed in 76us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832166.628032:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788832166.628086:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218403712:0@lo:400:kworker.0 00000100:00100000:2.0:1788832166.628673:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218403584:0@lo:400:kworker.0 00000100:00100000:2.0:1788832166.628719:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832166.628744:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218404096:0@lo:400:kworker.0 00000100:00100000:2.0:1788832166.628766:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832166.628781:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218404608:0@lo:400:kworker.0 00000100:00100000:2.0:1788832166.628800:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832166.628821:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788832166.628827:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b067f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875726218403456:0@lo:400:kworker.0 00000100:00100000:2.0:1788832166.628845:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832166.628862:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1875726218403968:0@lo:400:kworker.0 00000100:00100000:2.0:1788832166.628880:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832166.628889:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218404480:0@lo:400:kworker.0 00000100:00100000:2.0:1788832166.628908:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832166.628934:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218403840 00000100:00100000:2.0:1788832166.628940:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218403840 00000100:00100000:2.0:1788832166.628995:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218404352 00000100:00100000:2.0:1788832166.628998:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218404352 00000100:00100000:2.0:1788832166.629030:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218403584 00000100:00100000:2.0:1788832166.629033:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218403584 00000100:00100000:2.0:1788832166.629044:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218403456 00000100:00100000:2.0:1788832166.629047:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218403456 00000100:00100000:2.0:1788832166.629058:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218403968 00000100:00100000:2.0:1788832166.629060:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218403968 00000100:00100000:2.0:1788832166.629073:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218404480 00000100:00100000:2.0:1788832166.629075:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218404480 00000100:00100000:2.0:1788832166.629090:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788832166.629097:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218403840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832166.629326:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218403840:12345-0@lo:400:kworker.0 Request processed in 228us (1661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832166.629334:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788832166.629351:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788832166.629357:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875726218404352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832166.629386:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875726218404352:12345-0@lo:400:kworker.0 Request processed in 30us (1661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832166.629459:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788832166.629473:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788832166.629549:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218403584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832166.629588:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218403584:12345-0@lo:400:kworker.0 Request processed in 108us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832166.629595:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788832166.630130:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788832166.630147:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875726218403456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832166.630191:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875726218403456:12345-0@lo:400:kworker.0 Request processed in 49us (1344us total) trans 0 rc 0/0 00000100:00080000:3.0:1788832166.630389:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788832166.630407:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832166.630474:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875726218403456:0@lo:400:kworker.0 00000100:00100000:3.0:1788832166.630501:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b067f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218403584:0@lo:400:kworker.0 00000100:00100000:3.0:1788832166.630548:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218404224 00000100:00100000:3.0:1788832166.630553:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218404224 00000100:00100000:3.0:1788832166.630597:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218404096 00000100:00100000:3.0:1788832166.630599:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218404096 00000100:00100000:3.0:1788832166.630719:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218404608 00000100:00100000:3.0:1788832166.630723:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218404608 00000100:00100000:3.0:1788832166.630743:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788832166.630750:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3654:x1875726218404224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832166.630795:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3654:x1875726218404224:12345-0@lo:400:kworker.0 Request processed in 46us (2953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832166.630801:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788832166.630815:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788832166.630820:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218404096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832166.630847:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218404096:12345-0@lo:400:kworker.0 Request processed in 27us (2080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832166.630853:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788832166.630862:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788832166.630867:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218404608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832166.630890:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218404608:12345-0@lo:400:kworker.0 Request processed in 23us (2089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832166.630904:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788832166.633848:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788832166.633885:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875726218403968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832166.634017:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875726218403968:12345-0@lo:400:kworker.0 Request processed in 153us (5134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832166.634026:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788832166.634071:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788832166.634078:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875726218404480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832166.634112:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875726218404480:12345-0@lo:400:kworker.0 Request processed in 35us (5203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832166.634117:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788832166.634249:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218404224:0@lo:400:kworker.0 00000100:00100000:2.0:1788832166.634323:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:2.0:1788832166.634373:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788832166.634379:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788832166.634549:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcbb480 x1875726218403968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832166.634563:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1875726218403968:0@lo:400:kworker.0 00010000:00080000:2.0:1788832166.634578:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc04000 x1875726218404480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832166.634865:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218404480:0@lo:400:kworker.0 00000100:00100000:2.0:1788832166.634886:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218404096:0@lo:400:kworker.0 00010000:00080000:2.0:1788832166.634901:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc07800 x1875726218404608/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832166.634910:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218404608:0@lo:400:kworker.0 00000100:00100000:0.0:1788832166.637268:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218403840:0@lo:400:kworker.0 00000100:00100000:0.0:1788832166.637312:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1875726218404352:0@lo:400:kworker.0 10000000:01000000:2.0:1788832166.743532:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788832166.743544:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2c3fcaa000 from 7 10000000:01000000:2.0:1788832166.743551:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788832166.746974:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c00030a00/0x998c12b283537264 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832166.747008:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c00030a00/0x998c12b283537264 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832166.747037:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c00030a00/0x998c12b283537264 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832166.747085:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218404736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788832166.747222:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832166.747318:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788832166.747645:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218404736 00000100:00100000:3.0:1788832166.747761:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218404736 00000100:00100000:3.0:1788832166.747828:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788832166.747839:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+20:6522:x1875726218404736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832166.747904:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832166.747927:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c421d3600/0x998c12b28353726b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283537264 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832166.747964:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d3600/0x998c12b28353726b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283537264 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832166.747994:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c421d3600/0x998c12b28353726b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283537264 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832166.748007:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d3600, rc 0) 00000100:00100000:3.0:1788832166.748247:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218404736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 409us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832166.748256:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788832166.748472:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218404736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832166.748497:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c00030a00/0x998c12b283537264 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353726b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832166.748508:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c00030a00/0x998c12b283537264 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b28353726b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832166.748608:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218404864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832166.748676:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832166.748704:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7540 going to sleep for 11 seconds 00000100:00100000:0.0:1788832166.748896:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218404864 00000100:00100000:0.0:1788832166.748902:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218404864 00000100:00100000:0.0:1788832166.748949:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788832166.748958:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218404864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832166.749139:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218404864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832166.749162:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788832166.750069:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218404864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832166.750129:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218404992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832166.750193:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832166.750226:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218404992 00000100:00100000:3.0:1788832166.750237:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218404992 00000100:00100000:2.0:1788832166.750237:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7540 going to sleep for 11 seconds 00000100:00100000:2.0:1788832166.750341:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788832166.750351:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218404992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832166.750470:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218404992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832166.750478:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788832166.750493:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218404992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832166.751379:0:13796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:13796:1875726218405120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832166.751433:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832166.751471:0:13796:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7240 going to sleep for 11 seconds 00000100:00100000:3.0:1788832166.751585:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218405120 00000100:00100000:3.0:1788832166.751591:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218405120 00000100:00100000:3.0:1788832166.751645:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788832166.751767:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+21:13796:x1875726218405120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832166.752231:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+21:13796:x1875726218405120:12345-0@lo:502:llog_process_th.0 Request processed in 467us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832166.752246:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788832166.752384:0:13796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:13796:1875726218405120:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832166.752418:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832166.752428:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832166.752431:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788832166.752437:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d2c3fcaa000 00000020:00000080:2.0:1788832166.752440:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788832166.752518:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832166.752523:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832166.752524:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788832166.752527:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832166.752530:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832166.752531:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788832166.752535:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d2c3fcaa000 00000020:00000080:2.0:1788832166.752537:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788832166.752586:0:13796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:13796:1875726218405248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832166.752673:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832166.752710:0:13796:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7240 going to sleep for 11 seconds 00000100:00100000:3.0:1788832166.753195:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218405248 00000100:00100000:3.0:1788832166.753203:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218405248 00000100:00100000:3.0:1788832166.753251:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788832166.753260:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+21:13796:x1875726218405248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832166.753377:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+21:13796:x1875726218405248:12345-0@lo:502:llog_process_th.0 Request processed in 117us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832166.753385:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788832166.753498:0:13796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:13796:1875726218405248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788832166.753526:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832166.753533:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832166.753535:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788832166.753542:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788832166.754940:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788832166.755156:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788832166.755171:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c00030a00/0x998c12b283537264 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353726b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832166.755186:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c00030a00/0x998c12b283537264 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353726b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832166.755198:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788832166.755202:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2c3e677800 from 7 10000000:01000000:3.0:1788832166.755205:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788832166.755247:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3e00/0x998c12b283537272 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832166.755256:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3e00/0x998c12b283537272 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832166.755902:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3e00/0x998c12b283537272 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832166.755938:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218405376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788832166.756991:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832166.757696:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832166.758537:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218405376 00000100:00100000:1.0:1788832166.758552:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218405376 00000100:00100000:1.0:1788832166.758823:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788832166.758840:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+21:6522:x1875726218405376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788832166.758863:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832166.758888:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2b07cfe400/0x998c12b283537279 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283537272 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832166.758924:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2b07cfe400/0x998c12b283537279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283537272 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832166.758937:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2b07cfe400/0x998c12b283537279 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283537272 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832166.758961:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe400, rc 0) 00000100:00100000:1.0:1788832166.759057:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218405376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 222us (2089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832166.759691:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218405376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832166.759714:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3e00/0x998c12b283537272 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537279 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832166.759726:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3e00/0x998c12b283537272 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283537279 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832166.759826:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218405504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832166.759877:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832166.759915:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832166.759931:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218405504 00000100:00100000:3.0:1788832166.759936:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218405504 00000100:00100000:3.0:1788832166.760000:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788832166.760008:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218405504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832166.760401:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218405504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 393us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832166.760410:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788832166.760458:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218405504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832166.760508:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218405632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832166.760550:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832166.760564:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832166.760576:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218405632 00000100:00100000:3.0:1788832166.760592:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218405632 00000100:00100000:3.0:1788832166.760616:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788832166.760649:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218405632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832166.760731:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218405632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832166.760739:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788832166.760779:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218405632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832166.762035:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:13798:1875726218405760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832166.762106:0:13798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832166.762153:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832166.762752:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218405760 00000100:00100000:0.0:1788832166.762763:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218405760 00000100:00100000:0.0:1788832166.763747:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788832166.763772:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:13798:x1875726218405760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832166.763988:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:13798:x1875726218405760:12345-0@lo:502:llog_process_th.0 Request processed in 215us (1872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832166.763997:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788832166.764234:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788832166.765036:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:13798:1875726218405760:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832166.765087:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832166.765099:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832166.765102:0:13798:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788832166.765110:0:13798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d2c3e677800 00000020:00000080:2.0:1788832166.765113:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788832166.765997:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832166.766006:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832166.766008:0:13798:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788832166.766012:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832166.766015:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832166.766017:0:13798:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788832166.766021:0:13798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d2c3e677800 00000020:00000080:2.0:1788832166.766023:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788832166.768965:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:13798:1875726218405888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832166.769391:0:13798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832166.769510:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832166.769736:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218405888 00000100:00100000:0.0:1788832166.769747:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218405888 00000100:00100000:0.0:1788832166.769931:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788832166.769943:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+22:13798:x1875726218405888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832166.770571:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+22:13798:x1875726218405888:12345-0@lo:502:llog_process_th.0 Request processed in 625us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832166.770669:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788832166.770793:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:13798:1875726218405888:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832166.770836:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832166.770846:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832166.770849:0:13798:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788832166.770855:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788832166.771465:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788832166.771566:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788832166.771705:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3e00/0x998c12b283537272 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537279 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832166.771721:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3e00/0x998c12b283537272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537279 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832166.771734:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788832166.771738:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2c39185800 from 7 10000000:01000000:0.0:1788832166.771741:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788832166.771833:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b283537280 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832166.771850:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b283537280 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832166.771861:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b283537280 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832166.771891:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218406016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788832166.771951:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832166.772186:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c04ca7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832166.772390:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218406016 00000100:00100000:3.0:1788832166.772400:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218406016 00000100:00100000:3.0:1788832166.772465:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788832166.772475:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+22:6522:x1875726218406016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832166.772492:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832166.772508:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c421d2e00/0x998c12b283537287 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283537280 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832166.772537:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d2e00/0x998c12b283537287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283537280 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832166.772550:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c421d2e00/0x998c12b283537287 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283537280 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832166.772560:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2e00, rc 0) 00000100:00100000:3.0:1788832166.772615:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218406016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832166.773929:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788832166.774046:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218406016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832166.774084:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b283537280 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537287 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832166.774099:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b283537280 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283537287 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832166.774206:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218406144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832166.774266:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832166.774308:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832166.774328:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218406144 00000100:00100000:3.0:1788832166.774335:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218406144 00000100:00100000:3.0:1788832166.774371:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788832166.774381:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218406144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832166.774511:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218406144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832166.774519:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788832166.774547:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218406144:0@lo:501:ll_cfg_requeue.0 00000040:00080000:0.0:1788832166.774566:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788832166.774574:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218406272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832166.774616:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832166.774805:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218406272 00000100:00100000:1.0:1788832166.774810:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218406272 00000100:00100000:1.0:1788832166.774835:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788832166.774841:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218406272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788832166.774933:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218406272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832166.774940:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788832166.775196:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832166.775212:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218406272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832166.776856:0:13801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:13801:1875726218406400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832166.776941:0:13801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832166.777235:0:13801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832166.777352:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218406400 00000100:00100000:1.0:1788832166.777362:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218406400 00000100:00100000:1.0:1788832166.777497:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788832166.777508:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+23:13801:x1875726218406400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788832166.777711:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+23:13801:x1875726218406400:12345-0@lo:502:llog_process_th.0 Request processed in 204us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832166.777721:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788832166.778490:0:13801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:13801:1875726218406400:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832166.778539:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832166.778551:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832166.778554:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788832166.778562:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d2c39185800 00000020:00000080:2.0:1788832166.778566:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788832166.778670:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832166.778869:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832166.778872:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788832166.778877:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832166.778880:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832166.778882:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788832166.778886:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d2c39185800 00000020:00000080:2.0:1788832166.778888:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788832166.779496:0:13801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:13801:1875726218406528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832166.779805:0:13801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832166.780829:0:13801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832166.780882:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218406528 00000100:00100000:3.0:1788832166.780901:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218406528 00000100:00100000:3.0:1788832166.781136:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788832166.781149:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:13801:x1875726218406528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832166.781416:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+23:13801:x1875726218406528:12345-0@lo:502:llog_process_th.0 Request processed in 269us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832166.781425:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788832166.781785:0:13801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:13801:1875726218406528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832166.781825:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832166.781834:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832166.781844:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788832166.781851:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788832166.782805:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788832166.783080:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788832166.783097:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b283537280 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537287 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832166.783112:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b283537280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537287 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832166.783126:0:6522:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788832166.783129:0:6522:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2c40623800 from 7 10000000:01000000:0.0:1788832166.783133:0:6522:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788832166.783180:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b28353728e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832166.783188:0:6522:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b28353728e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832166.783199:0:6522:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b28353728e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832166.783238:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218406656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788832166.783314:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832166.783738:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b0622f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832166.789193:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218406656 00000100:00100000:1.0:1788832166.789213:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218406656 00000100:00100000:1.0:1788832166.789318:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788832166.789331:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+23:6522:x1875726218406656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788832166.789352:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832166.790214:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2b07cff800/0x998c12b283537295 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b28353728e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832166.790282:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2b07cff800/0x998c12b283537295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b28353728e expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832166.790295:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2b07cff800/0x998c12b283537295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b28353728e expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832166.790307:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cff800, rc 0) 00000100:00100000:1.0:1788832166.790412:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:6522:x1875726218406656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1082us (7095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832166.790420:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788832166.792353:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218406656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832166.792390:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b28353728e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537295 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832166.792407:0:6522:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b28353728e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283537295 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832166.792515:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218406784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832166.792591:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832166.792676:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b0622f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832166.792794:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218406784 00000100:00100000:1.0:1788832166.792802:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218406784 00000100:00100000:1.0:1788832166.792864:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788832166.792874:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:6522:x1875726218406784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832166.793053:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:6522:x1875726218406784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832166.793063:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788832166.793108:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218406784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832166.793143:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b073bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218406912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788832166.793187:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832166.793207:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3483f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788832166.793218:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218406912 00000100:00100000:1.0:1788832166.793221:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218406912 00000100:00100000:1.0:1788832166.793237:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788832166.793243:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:6522:x1875726218406912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788832166.793334:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:6522:x1875726218406912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832166.793341:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788832166.793378:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b073bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e55f0905-9d39-4464-9830-326b420fb582:6522:1875726218406912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832166.798350:0:13803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:13803:1875726218407040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832166.798461:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832166.798508:0:13803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b0622f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788832166.798573:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218407040 00000100:00100000:1.0:1788832166.798582:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218407040 00000100:00100000:1.0:1788832166.798674:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788832166.798685:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:13803:x1875726218407040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788832166.798839:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:13803:x1875726218407040:12345-0@lo:502:llog_process_th.0 Request processed in 155us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832166.798847:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788832166.799031:0:13803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:13803:1875726218407040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832166.799066:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832166.799077:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832166.799081:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788832166.799089:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d2c40623800 00000020:00000080:2.0:1788832166.799092:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788832166.799176:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832166.799180:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832166.799181:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788832166.799184:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832166.799187:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832166.799188:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788832166.799191:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d2c40623800 00000020:00000080:2.0:1788832166.799193:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788832166.799232:0:13803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:13803:1875726218407168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832166.799272:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832166.799299:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218407168 00000100:00100000:2.0:1788832166.799303:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218407168 00000100:00100000:2.0:1788832166.799328:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788832166.799334:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:13803:x1875726218407168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832166.799409:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:13803:x1875726218407168:12345-0@lo:502:llog_process_th.0 Request processed in 75us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832166.799415:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788832166.799453:0:13803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832166.799466:0:13803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3e774000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e55f0905-9d39-4464-9830-326b420fb582:13803:1875726218407168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832166.799484:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832166.799494:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832166.799496:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788832166.799500:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000040:00080000:2.0:1788832166.800243:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:1.0:1788832166.800958:0:6522:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788832166.800998:0:6522:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788832166.801012:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b28353728e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537295 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832166.801028:0:6522:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b28353728e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537295 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832167.128491:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832167.128528:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218407296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788832167.128746:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832167.129054:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218407296 00000100:00100000:0.0:1788832167.129066:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218407296 00000100:00100000:0.0:1788832167.129148:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788832167.129161:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218407296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788832167.129192:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832167.129266:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218407296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832167.129275:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:2.0:1788832167.129439:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b070bb800 x1875726218407296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832167.129463:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218407296:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788832167.383013:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832167.639823:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218407424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832167.639926:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832167.640219:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218407424 00000100:00100000:0.0:1788832167.640249:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218407424 00000100:00100000:0.0:1788832167.640316:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788832167.640327:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218407424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788832167.640377:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832167.640443:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218407424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832167.640451:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788832167.640616:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218407424:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1788832167.832990:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788832167.833540:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788832168.153733:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788832168.153767:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218407552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788832168.153986:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832168.154146:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218407552 00000100:00100000:0.0:1788832168.154158:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218407552 00000100:00100000:0.0:1788832168.154240:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788832168.154263:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875726218407552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788832168.154297:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832168.154364:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875726218407552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832168.154373:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788832168.154430:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218407552:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788832168.156714:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788832168.407774:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832168.661530:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832168.662467:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832168.662513:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832168.663725:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202596736 00000100:00100000:3.0:1788832168.663741:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202596736 00000100:00100000:3.0:1788832168.663856:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 82 00000100:00100000:3.0:1788832168.663868:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202596736:12345-192.168.203.26@tcp:400:kworker.0 00000100:00080000:2.0:1788832168.664063:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788832168.664230:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202596736:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 362us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832168.664240:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 82 00000100:00100000:1.0:1788832168.666758:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832168.666811:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832168.667051:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202596352 00000100:00100000:3.0:1788832168.667064:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202596352 00000100:00100000:3.0:1788832168.667132:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 365 00000100:00100000:3.0:1788832168.667144:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2396:x1875726202596352:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832168.667250:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2396:x1875726202596352:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 95us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832168.667259:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 365 00000100:00100000:0.0:1788832168.667843:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202596480 00000100:00100000:0.0:1788832168.667961:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202596480 00000100:00100000:0.0:1788832168.668165:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202596992 00000100:00100000:0.0:1788832168.668170:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202596992 00000100:00100000:1.0:1788832168.668335:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832168.668355:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202596608 00000100:00100000:1.0:1788832168.668359:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202596608 00000100:00080000:3.0:1788832168.668386:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788832168.668391:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832168.668424:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202596864 00000100:00100000:3.0:1788832168.668428:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202596864 00000100:00100000:3.0:1788832168.668459:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 209 00000100:00100000:3.0:1788832168.668470:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202596480:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832168.668557:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202596480:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 90us (7046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832168.668565:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 209 00000100:00100000:3.0:1788832168.668585:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 210 00000100:00100000:3.0:1788832168.668591:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202596864:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832168.668638:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202596864:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832168.668646:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 210 00000100:00080000:3.0:1788832168.668663:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832168.669734:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 211 00000100:00100000:0.0:1788832168.669747:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202596992:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832168.669811:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202596992:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 68us (7296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832168.669818:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 211 00000100:00100000:1.0:1788832168.670987:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 212 00000100:00100000:1.0:1788832168.671003:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202596608:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832168.671079:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202596608:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 81us (4267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832168.671086:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 212 00010000:00010000:2.0:1788832169.433598:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832170.454999:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832170.713370:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218407680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788832170.713461:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1788832170.714539:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:3.0:1788832170.716605:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218407680 00000100:00100000:3.0:1788832170.716632:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218407680 00000100:00100000:3.0:1788832170.716823:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788832170.716835:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218407680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788832170.716874:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788832170.716976:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218407680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (3514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832170.716983:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788832170.717095:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218407680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788832171.223861:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832171.223886:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218407808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788832171.223979:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832171.224163:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218407808 00000100:00100000:0.0:1788832171.224181:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218407808 00000100:00100000:0.0:1788832171.224240:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788832171.224250:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218407808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788832171.224288:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788832171.224349:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218407808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832171.224356:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788832171.224517:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218407808:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788832171.479040:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832171.734980:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b070bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218407936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832171.735067:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832171.735209:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875726218408192:0@lo:400:kworker.0 00000100:00100000:3.0:1788832171.735289:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218407936 00000100:00100000:3.0:1788832171.735296:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218407936 00000100:00100000:0.0:1788832171.735301:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832171.735335:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1875726218408704:0@lo:400:kworker.0 00000100:00100000:2.0:1788832171.735344:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218408320:0@lo:400:kworker.0 00000100:00100000:3.0:1788832171.735365:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788832171.735365:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832171.735381:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218407936:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788832171.735389:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788832171.735393:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218409216:0@lo:400:kworker.0 00002000:00000024:3.0:1788832171.735416:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788832171.735416:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218408192 00000100:00100000:0.0:1788832171.735418:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832171.735420:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218408192 00000100:00100000:0.0:1788832171.735443:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788832171.735451:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218408064:0@lo:400:kworker.0 00000100:00100000:2.0:1788832171.735452:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218408704 00000100:00100000:2.0:1788832171.735455:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218408704 00000100:00100000:2.0:1788832171.735473:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218409216 00000100:00100000:2.0:1788832171.735476:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218409216 00000100:00100000:0.0:1788832171.735491:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832171.735496:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218407936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832171.735497:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788832171.735508:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875726218408192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832171.735511:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788832171.735513:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1875726218408576:0@lo:400:kworker.0 00000100:00100000:0.0:1788832171.735539:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832171.735545:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875726218408192:12345-0@lo:400:kworker.0 Request processed in 39us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832171.735551:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1875726218409088:0@lo:400:kworker.0 00000100:00100000:2.0:1788832171.735558:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788832171.735569:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218408576 00000100:00100000:0.0:1788832171.735571:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832171.735575:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218408576 00000100:00100000:2.0:1788832171.735576:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788832171.735586:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875726218408704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832171.735598:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875726218408192:0@lo:400:kworker.0 00000100:00100000:3.0:1788832171.735604:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218409088 00000100:00100000:3.0:1788832171.735609:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218409088 00000100:00100000:2.0:1788832171.735617:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875726218408704:12345-0@lo:400:kworker.0 Request processed in 32us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832171.735656:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00010000:00080000:0.0:1788832171.735657:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc04000 x1875726218408704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832171.735666:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875726218409216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832171.735677:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1875726218408704:0@lo:400:kworker.0 00000100:00100000:0.0:1788832171.735736:0:6525:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788832171.735743:0:6525:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788832171.735834:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832171.735851:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218408832:0@lo:400:kworker.0 00000100:00100000:2.0:1788832171.735859:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788832171.735871:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218408320 00000100:00100000:2.0:1788832171.735875:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218408320 00000100:00100000:0.0:1788832171.735876:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832171.735889:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788832171.735892:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218409344:0@lo:400:kworker.0 00000100:00100000:2.0:1788832171.735895:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875726218408576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832171.735911:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832171.735925:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875726218408576:12345-0@lo:400:kworker.0 Request processed in 30us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832171.735928:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788832171.735931:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788832171.735933:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218408448:0@lo:400:kworker.0 00000100:00100000:2.0:1788832171.735942:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788832171.735961:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875726218409088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832171.735971:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832171.735989:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875726218409088:12345-0@lo:400:kworker.0 Request processed in 41us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832171.735989:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218408960:0@lo:400:kworker.0 00000100:00100000:2.0:1788832171.735995:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788832171.736008:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788832171.736008:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832171.736013:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218408320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832171.736030:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218408832 00000100:00100000:0.0:1788832171.736033:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218408832 00000100:00100000:2.0:1788832171.736043:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218408320:12345-0@lo:400:kworker.0 Request processed in 30us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832171.736049:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788832171.736058:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218409344 00000100:00100000:0.0:1788832171.736061:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218409344 00000100:00100000:0.0:1788832171.736077:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218408960 00000100:00100000:0.0:1788832171.736080:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218408960 00000100:00100000:0.0:1788832171.736095:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788832171.736101:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218408832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832171.736132:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218408832:12345-0@lo:400:kworker.0 Request processed in 31us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832171.736138:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788832171.736150:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788832171.736156:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218409344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832171.736182:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218409344:12345-0@lo:400:kworker.0 Request processed in 27us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832171.736197:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788832171.736209:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788832171.736215:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218408960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832171.736244:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218408960:12345-0@lo:400:kworker.0 Request processed in 29us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832171.736250:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1788832171.736420:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788832171.736423:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788832171.736425:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788832171.736427:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788832171.736450:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788832171.736456:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d2c182ab100, transno 4294967301 00000100:00100000:0.0:1788832171.736469:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218408960:0@lo:400:kworker.0 00000100:00100000:0.0:1788832171.736481:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218408320:0@lo:400:kworker.0 00000100:00100000:0.0:1788832171.736490:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218408832:0@lo:400:kworker.0 00010000:00080000:0.0:1788832171.736499:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36c89c00 x1875726218409344/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832171.736508:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218409344:0@lo:400:kworker.0 00000100:00100000:0.0:1788832171.736536:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1875726218408576:0@lo:400:kworker.0 00000100:00100000:0.0:1788832171.736545:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1875726218409088:0@lo:400:kworker.0 00000100:00100000:0.0:1788832171.736576:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218408448 00000100:00100000:0.0:1788832171.736580:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218408448 00000100:00100000:0.0:1788832171.736606:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788832171.736612:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218408448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832171.736689:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218408448:12345-0@lo:400:kworker.0 Request processed in 77us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832171.736696:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788832171.736722:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218408448:0@lo:400:kworker.0 00000100:00100000:1.0:1788832171.737242:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218408064 00000100:00100000:1.0:1788832171.737247:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218408064 00000100:00100000:1.0:1788832171.737291:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788832171.737299:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3652:x1875726218408064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832171.737348:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3652:x1875726218408064:12345-0@lo:400:kworker.0 Request processed in 49us (1856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832171.737354:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00010000:00080000:1.0:1788832171.737419:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b070bad80 x1875726218407936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832171.737440:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b070bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218407936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832171.737471:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218408064:0@lo:400:kworker.0 00000100:00100000:3.0:1788832171.738115:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875726218409216:12345-0@lo:400:kworker.0 Request processed in 2449us (2692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832171.738126:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00010000:00080000:1.0:1788832171.739715:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36c8bb80 x1875726218409216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832171.740197:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218409216:0@lo:400:kworker.0 00000100:00100000:1.0:1788832172.247549:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218409472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788832172.247676:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832172.248202:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218409472 00000100:00100000:0.0:1788832172.248214:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218409472 00000100:00100000:0.0:1788832172.248296:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788832172.248310:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218409472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788832172.248338:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832172.248411:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218409472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832172.248418:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:1.0:1788832172.249112:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc05500 x1875726218409472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832172.249141:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218409472:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788832172.503064:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832172.759009:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832172.759050:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218409600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832172.759120:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832172.759288:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218409600 00000100:00100000:0.0:1788832172.759295:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218409600 00000100:00100000:0.0:1788832172.759363:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788832172.759968:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218409600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788832172.760000:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832172.760068:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218409600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832172.760144:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218409600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788832172.763133:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788832173.272068:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218409728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788832173.272165:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832173.272383:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218409728 00000100:00100000:3.0:1788832173.272390:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218409728 00000100:00100000:3.0:1788832173.272458:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788832173.272469:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218409728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788832173.272491:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832173.272541:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218409728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832173.272548:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788832173.272594:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218409728:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788832173.273176:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788832173.528071:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832173.788718:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832173.788803:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832173.788841:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832173.788867:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832173.788888:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832173.788912:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832173.789006:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202597120 00000100:00100000:3.0:1788832173.789016:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202597120 00000100:00100000:3.0:1788832173.789083:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 367 00000100:00100000:3.0:1788832173.789094:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2394:x1875726202597120:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832173.789161:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2394:x1875726202597120:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 69us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832173.789181:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 367 00000100:00100000:1.0:1788832173.789610:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202597376 00000100:00100000:1.0:1788832173.789616:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202597376 00000100:00100000:1.0:1788832173.789681:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202597632 00000100:00100000:1.0:1788832173.789685:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202597632 00000100:00100000:1.0:1788832173.789697:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202597248 00000100:00100000:1.0:1788832173.789699:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202597248 00000100:00100000:1.0:1788832173.789711:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202597760 00000100:00100000:1.0:1788832173.789713:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202597760 00000100:00100000:1.0:1788832173.789727:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 219 00000100:00100000:1.0:1788832173.789735:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2394:x1875726202597376:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832173.789787:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 220 00000100:00100000:1.0:1788832173.789801:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2394:x1875726202597376:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 64us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832173.789811:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2394:x1875726202597632:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832173.789813:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 219 00000100:00100000:1.0:1788832173.789838:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 221 00000100:00100000:1.0:1788832173.789849:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202597248:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832173.789896:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2394:x1875726202597632:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 95us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832173.789900:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202597248:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 50us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832173.789918:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 220 00000100:00080000:2.0:1788832173.789998:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788832173.790004:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788832173.790067:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202597504 00000100:00100000:0.0:1788832173.790083:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202597504 00000100:00100000:0.0:1788832173.790123:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 86 00000100:00100000:0.0:1788832173.790131:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202597504:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832173.790162:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202597504:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 33us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832173.790177:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 86 00000100:00080000:0.0:1788832173.790196:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832173.790430:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 221 00000100:00100000:1.0:1788832173.790450:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 222 00000100:00100000:1.0:1788832173.790458:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202597760:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832173.790522:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202597760:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 65us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832173.790529:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 222 00010000:00010000:2.0:1788832174.550914:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832175.575742:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832175.831058:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832175.831083:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218409856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788832175.831221:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832175.831435:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218409856 00000100:00100000:3.0:1788832175.831443:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218409856 00000100:00100000:3.0:1788832175.831501:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788832175.831511:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218409856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788832175.831546:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788832175.832363:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218409856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 851us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832175.832373:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788832175.832532:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218409856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788832176.342950:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218409984:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788832176.343023:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832176.343203:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218409984 00000100:00100000:0.0:1788832176.343213:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218409984 00000100:00100000:0.0:1788832176.343275:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788832176.343285:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218409984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788832176.343322:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788832176.343396:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218409984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832176.343404:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788832176.343612:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218409984:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788832176.599196:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832176.855214:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218410112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832176.855323:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832176.856493:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218410368:0@lo:400:kworker.0 00000100:00100000:2.0:1788832176.856539:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832176.856561:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218410880:0@lo:400:kworker.0 00000100:00100000:2.0:1788832176.856581:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832176.856602:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218411392:0@lo:400:kworker.0 00000100:00100000:2.0:1788832176.856640:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832176.856663:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788832176.856668:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218410496:0@lo:400:kworker.0 00000100:00100000:2.0:1788832176.856690:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832176.856705:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218411008:0@lo:400:kworker.0 00000100:00100000:2.0:1788832176.856725:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832176.856750:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218411520:0@lo:400:kworker.0 00000100:00100000:2.0:1788832176.856783:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832176.856807:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218410368 00000100:00100000:2.0:1788832176.856819:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218410368 00000100:00100000:2.0:1788832176.856857:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218410880 00000100:00100000:2.0:1788832176.856860:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218410880 00000100:00100000:2.0:1788832176.856879:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218411392 00000100:00100000:2.0:1788832176.856882:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218411392 00000100:00100000:2.0:1788832176.856892:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218410496 00000100:00100000:2.0:1788832176.856894:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218410496 00000100:00100000:2.0:1788832176.856908:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788832176.856927:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218410368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832176.856979:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218410368:12345-0@lo:400:kworker.0 Request processed in 53us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832176.856985:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788832176.857001:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788832176.857008:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218410880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832176.857032:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218410880:12345-0@lo:400:kworker.0 Request processed in 25us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832176.857037:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788832176.857047:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788832176.857052:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218411392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832176.857074:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218411392:12345-0@lo:400:kworker.0 Request processed in 22us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832176.857080:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788832176.857089:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788832176.857095:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218410496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832176.857140:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218410496:12345-0@lo:400:kworker.0 Request processed in 45us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832176.857146:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788832176.857183:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218410496:0@lo:400:kworker.0 00000100:00100000:2.0:1788832176.857195:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218410368:0@lo:400:kworker.0 00010000:00080000:2.0:1788832176.857206:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fd0dc00 x1875726218410880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832176.857216:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218410880:0@lo:400:kworker.0 00010000:00080000:2.0:1788832176.857225:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fd0ca80 x1875726218411392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832176.857233:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218411392:0@lo:400:kworker.0 00000100:00100000:0.0:1788832176.859254:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218410112 00000100:00100000:0.0:1788832176.859269:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218410112 00000100:00100000:0.0:1788832176.859337:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788832176.859349:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218410112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788832176.859379:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832176.859446:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218410112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (4122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832176.859453:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788832176.859479:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218411008 00000100:00100000:0.0:1788832176.859483:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218411008 00000100:00100000:0.0:1788832176.859508:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218411520 00000100:00100000:0.0:1788832176.859526:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218411520 00000100:00100000:0.0:1788832176.859551:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788832176.859557:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218411008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832176.859599:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218411008:12345-0@lo:400:kworker.0 Request processed in 41us (2872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832176.859605:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788832176.859676:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788832176.859682:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218411520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832176.859713:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218411520:12345-0@lo:400:kworker.0 Request processed in 31us (2929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832176.859720:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1788832176.860072:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788832176.860077:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788832176.860079:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788832176.860148:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218411008:0@lo:400:kworker.0 00010000:00080000:0.0:1788832176.860163:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fd0e300 x1875726218411520/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832176.860174:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218411520:0@lo:400:kworker.0 00000100:00100000:1.0:1788832176.861459:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218410624:0@lo:400:kworker.0 00000100:00100000:1.0:1788832176.861519:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832176.861573:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218411136:0@lo:400:kworker.0 00000100:00100000:1.0:1788832176.861597:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788832176.861655:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc05500 x1875726218410112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832176.861675:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218410112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832176.861711:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788832176.861718:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218410240:0@lo:400:kworker.0 00000100:00100000:1.0:1788832176.861744:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832176.861772:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218410752:0@lo:400:kworker.0 00000100:00100000:1.0:1788832176.861796:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832176.861824:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1875726218411264:0@lo:400:kworker.0 00000100:00100000:1.0:1788832176.861844:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832176.861870:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218411136 00000100:00100000:1.0:1788832176.861875:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218411136 00000100:00100000:1.0:1788832176.861932:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788832176.861940:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218411136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832176.861985:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218411136:12345-0@lo:400:kworker.0 Request processed in 47us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832176.861992:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788832176.862013:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218410240 00000100:00100000:1.0:1788832176.862017:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218410240 00000100:00100000:1.0:1788832176.862037:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788832176.862044:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218410240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832176.862070:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218410240:12345-0@lo:400:kworker.0 Request processed in 27us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832176.862086:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788832176.862110:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218410752 00000100:00100000:1.0:1788832176.862114:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218410752 00000100:00100000:1.0:1788832176.862135:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218411264 00000100:00100000:1.0:1788832176.862138:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218411264 00000100:00100000:1.0:1788832176.862154:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788832176.862160:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218410752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832176.862189:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218410752:12345-0@lo:400:kworker.0 Request processed in 29us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832176.862195:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788832176.862206:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788832176.862212:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875726218411264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832176.862237:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875726218411264:12345-0@lo:400:kworker.0 Request processed in 26us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832176.862242:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:1.0:1788832176.862257:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788832176.862261:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832176.862287:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218410240:0@lo:400:kworker.0 00000100:00100000:1.0:1788832176.862297:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218410752:0@lo:400:kworker.0 00000100:00100000:1.0:1788832176.862305:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1875726218411264:0@lo:400:kworker.0 00000100:00100000:0.0:1788832176.862311:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218410624 00000100:00100000:1.0:1788832176.862313:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218411136:0@lo:400:kworker.0 00000100:00100000:0.0:1788832176.862315:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218410624 00000100:00100000:0.0:1788832176.862340:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788832176.862346:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218410624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832176.862390:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218410624:12345-0@lo:400:kworker.0 Request processed in 44us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832176.862396:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788832176.862988:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218410624:0@lo:400:kworker.0 00000040:00080000:2.0:1788832177.047354:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788832177.048185:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788832177.369478:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832177.370271:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218411648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788832177.370336:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832177.370454:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218411648 00000100:00100000:0.0:1788832177.370462:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218411648 00000100:00100000:0.0:1788832177.370511:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788832177.370520:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218411648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788832177.370542:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832177.370581:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218411648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832177.370604:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:2.0:1788832177.370731:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc07b80 x1875726218411648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832177.370749:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218411648:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788832177.623101:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832177.879046:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788832177.879071:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218411776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788832177.879160:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832177.879214:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218411776 00000100:00100000:0.0:1788832177.879314:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218411776 00000100:00100000:0.0:1788832177.879422:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788832177.879432:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218411776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788832177.879463:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832177.879518:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218411776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832177.879526:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788832177.879673:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218411776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832178.390965:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218411904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832178.391031:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832178.391809:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218411904 00000100:00100000:0.0:1788832178.391818:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218411904 00000100:00100000:0.0:1788832178.391880:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788832178.391890:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218411904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788832178.391920:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832178.391982:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218411904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832178.391988:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788832178.392069:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218411904:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788832178.393404:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788832178.646874:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832178.900879:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832178.900934:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832178.900983:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832178.901024:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832178.901046:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832178.901067:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832178.901101:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202597888 00000100:00100000:2.0:1788832178.901110:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202597888 00000100:00100000:2.0:1788832178.901160:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 369 00000100:00100000:2.0:1788832178.901170:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2393:x1875726202597888:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832178.901238:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2393:x1875726202597888:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 69us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832178.901245:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 369 00000100:00100000:2.0:1788832178.901289:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202598016 00000100:00100000:2.0:1788832178.901293:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202598016 00000100:00100000:2.0:1788832178.901460:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202598528 00000100:00100000:2.0:1788832178.901465:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202598528 00000100:00100000:2.0:1788832178.901478:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202598144 00000100:00100000:2.0:1788832178.901480:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202598144 00000100:00100000:2.0:1788832178.901491:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202598400 00000100:00100000:2.0:1788832178.901493:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202598400 00000100:00100000:2.0:1788832178.901507:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 229 00000100:00100000:2.0:1788832178.901513:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202598016:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832178.901544:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202598016:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 30us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832178.901552:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 229 00000100:00100000:2.0:1788832178.901567:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 230 00000100:00100000:2.0:1788832178.901572:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202598528:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832178.901596:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202598528:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832178.901609:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 230 00000100:00100000:2.0:1788832178.901660:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 231 00000100:00100000:2.0:1788832178.901668:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202598144:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832178.901795:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202598272 00000100:00100000:0.0:1788832178.901799:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202598272 00000100:00100000:0.0:1788832178.901832:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 90 00000100:00100000:0.0:1788832178.901840:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202598272:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832178.901868:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202598272:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 29us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832178.901874:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 90 00000100:00100000:0.0:1788832178.901927:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 232 00000100:00100000:0.0:1788832178.901934:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202598400:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832178.901967:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202598400:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 34us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832178.901973:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 232 00000100:00080000:1.0:1788832178.902122:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788832178.902128:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788832178.902130:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832178.902234:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202598144:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 566us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832178.902242:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 231 00010000:00010000:2.0:1788832179.672364:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832180.696305:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832180.953595:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788832180.953639:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218412032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788832180.953709:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832180.953796:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218412032 00000100:00100000:0.0:1788832180.953805:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218412032 00000100:00100000:0.0:1788832180.953857:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788832180.953867:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218412032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788832180.953906:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788832180.953960:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218412032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832180.953968:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788832180.953999:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218412032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788832181.463300:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218412160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788832181.463449:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832181.463870:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218412160 00000100:00100000:0.0:1788832181.463879:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218412160 00000100:00100000:0.0:1788832181.463952:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788832181.463962:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218412160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788832181.463996:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788832181.464057:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218412160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832181.464063:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788832181.464260:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218412160:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788832181.719135:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832181.975116:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788832181.975139:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218412288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832181.975211:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832181.975343:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218412288 00000100:00100000:0.0:1788832181.975352:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218412288 00000100:00100000:0.0:1788832181.975419:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788832181.975430:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218412288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788832181.975459:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832181.975513:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218412288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832181.975536:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1788832181.975593:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788832181.976594:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218412672:0@lo:400:kworker.0 00000100:00100000:3.0:1788832181.976662:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832181.976691:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218413184:0@lo:400:kworker.0 00000100:00100000:3.0:1788832181.976717:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832181.976741:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218413696:0@lo:400:kworker.0 00000100:00100000:3.0:1788832181.976762:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788832181.976793:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc04a80 x1875726218412288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832181.976813:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218412288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832181.976832:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788832181.976837:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218412800:0@lo:400:kworker.0 00000100:00100000:3.0:1788832181.976861:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832181.976891:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218413312:0@lo:400:kworker.0 00000100:00100000:3.0:1788832181.976914:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832181.976930:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218413824:0@lo:400:kworker.0 00000100:00100000:3.0:1788832181.976948:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832181.977037:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218412416:0@lo:400:kworker.0 00000100:00100000:2.0:1788832181.977070:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832181.977096:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218412928:0@lo:400:kworker.0 00000100:00100000:2.0:1788832181.977115:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832181.977128:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218413440:0@lo:400:kworker.0 00000100:00100000:2.0:1788832181.977146:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832181.977161:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788832181.977166:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218412544:0@lo:400:kworker.0 00000100:00100000:2.0:1788832181.977185:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832181.977203:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218413056:0@lo:400:kworker.0 00000100:00100000:2.0:1788832181.977225:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832181.977242:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218413568:0@lo:400:kworker.0 00000100:00100000:2.0:1788832181.977277:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832181.977312:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218413184 00000100:00100000:2.0:1788832181.977318:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218413184 00000100:00100000:2.0:1788832181.977357:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218413696 00000100:00100000:2.0:1788832181.977374:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218413696 00000100:00100000:2.0:1788832181.977392:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218412800 00000100:00100000:2.0:1788832181.977395:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218412800 00000100:00100000:2.0:1788832181.977406:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218412544 00000100:00100000:2.0:1788832181.977408:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218412544 00000100:00100000:2.0:1788832181.977417:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218413056 00000100:00100000:2.0:1788832181.977419:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218413056 00000100:00100000:2.0:1788832181.977431:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218413568 00000100:00100000:2.0:1788832181.977434:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218413568 00000100:00100000:2.0:1788832181.977451:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788832181.977459:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218413184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832181.977507:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218413184:12345-0@lo:400:kworker.0 Request processed in 49us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832181.977514:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788832181.977530:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788832181.977536:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875726218413696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832181.977563:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875726218413696:12345-0@lo:400:kworker.0 Request processed in 27us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832181.977569:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788832181.977582:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788832181.977588:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218412800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832181.977617:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218412800:12345-0@lo:400:kworker.0 Request processed in 29us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832181.977653:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788832181.977666:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788832181.977672:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218412544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832181.977705:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218412544:12345-0@lo:400:kworker.0 Request processed in 33us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832181.977719:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788832181.977732:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788832181.977739:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218413056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832181.977768:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218413056:12345-0@lo:400:kworker.0 Request processed in 30us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832181.977774:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788832181.977785:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788832181.977792:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218413568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832181.977818:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218413568:12345-0@lo:400:kworker.0 Request processed in 27us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832181.977824:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788832181.977859:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218412544:0@lo:400:kworker.0 00000100:00100000:2.0:1788832181.977868:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218413056:0@lo:400:kworker.0 00000100:00100000:2.0:1788832181.977889:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218413568:0@lo:400:kworker.0 00000100:00100000:2.0:1788832181.977922:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218412800:0@lo:400:kworker.0 00010000:00080000:2.0:1788832181.977936:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36c89c00 x1875726218413184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832181.977944:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218412672 00000100:00100000:2.0:1788832181.977947:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218413184:0@lo:400:kworker.0 00000100:00100000:0.0:1788832181.977950:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218412672 00010000:00080000:2.0:1788832181.977960:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07654a80 x1875726218413696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832181.977970:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218413696:0@lo:400:kworker.0 00000100:00100000:0.0:1788832181.977987:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218412928 00000100:00100000:0.0:1788832181.977992:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218412928 00000100:00100000:0.0:1788832181.978012:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788832181.978022:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788832181.978024:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218412672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832181.978042:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218412928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832181.978079:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218412672:12345-0@lo:400:kworker.0 Request processed in 60us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832181.978088:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788832181.978099:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218412928:12345-0@lo:400:kworker.0 Request processed in 59us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832181.978107:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788832181.978127:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218412672:0@lo:400:kworker.0 00000100:00100000:2.0:1788832181.978149:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218412928:0@lo:400:kworker.0 00000100:00100000:1.0:1788832181.978296:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218413312 00000100:00100000:1.0:1788832181.978301:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218413312 00000100:00100000:1.0:1788832181.978339:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218413824 00000100:00100000:1.0:1788832181.978342:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218413824 00000100:00100000:1.0:1788832181.978371:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218413440 00000100:00100000:1.0:1788832181.978374:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218413440 00000100:00100000:1.0:1788832181.978390:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788832181.978396:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218413312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832181.978439:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218413312:12345-0@lo:400:kworker.0 Request processed in 43us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832181.978445:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788832181.978457:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788832181.978463:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218413824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832181.978487:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218412416 00000100:00100000:3.0:1788832181.978494:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218412416 00000100:00100000:1.0:1788832181.978496:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218413824:12345-0@lo:400:kworker.0 Request processed in 33us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832181.978504:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788832181.978519:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788832181.978526:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218413440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832181.978535:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1788832181.978548:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:3653:x1875726218412416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832181.978578:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218413440:12345-0@lo:400:kworker.0 Request processed in 52us (1430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832181.978585:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788832181.978601:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:3653:x1875726218412416:12345-0@lo:400:kworker.0 Request processed in 55us (1529us total) trans 0 rc 0/0 00000100:00080000:1.0:1788832181.978609:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788832181.978610:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00080000:1.0:1788832181.978614:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788832181.978643:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788832181.978648:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788832181.978687:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218413312:0@lo:400:kworker.0 00010000:00080000:1.0:1788832181.978701:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07657b80 x1875726218413824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832181.978710:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218413824:0@lo:400:kworker.0 00000100:00100000:2.0:1788832181.978956:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218412416:0@lo:400:kworker.0 00000100:00100000:2.0:1788832181.978968:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218413440:0@lo:400:kworker.0 00000100:00100000:1.0:1788832182.491164:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832182.491189:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218413952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788832182.491257:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832182.491551:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218413952 00000100:00100000:3.0:1788832182.491560:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218413952 00000100:00100000:3.0:1788832182.491641:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788832182.491651:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218413952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788832182.491673:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832182.491730:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218413952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832182.491736:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:1.0:1788832182.491812:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc05c00 x1875726218413952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832182.491829:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218413952:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788832182.745295:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832182.998962:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218414080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788832182.999042:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832182.999908:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218414080 00000100:00100000:3.0:1788832182.999920:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218414080 00000100:00100000:3.0:1788832183.000553:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788832183.000567:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218414080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788832183.000602:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832183.000715:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218414080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 152us (1672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832183.000723:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788832183.000819:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218414080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832183.513087:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832183.513130:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218414208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832183.513201:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832183.513340:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218414208 00000100:00100000:0.0:1788832183.513349:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218414208 00000100:00100000:0.0:1788832183.513425:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788832183.513436:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218414208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788832183.513472:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832183.513527:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218414208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832183.513534:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1788832183.513752:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832183.513963:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218414208:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788832183.767765:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832184.021352:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832184.021400:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832184.021442:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832184.021532:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202598912 00000100:00100000:2.0:1788832184.021541:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202598912 00000100:00100000:2.0:1788832184.021605:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202598784 00000100:00100000:2.0:1788832184.021608:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202598784 00000100:00100000:2.0:1788832184.021672:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 239 00000100:00100000:2.0:1788832184.021682:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202598912:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832184.021759:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202598912:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 78us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832184.021767:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 239 00000100:00100000:2.0:1788832184.021784:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 240 00000100:00100000:2.0:1788832184.021791:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202598784:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832184.021818:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202598784:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832184.021838:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 240 00000100:00100000:2.0:1788832184.021988:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202598656 00000100:00100000:2.0:1788832184.021993:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202598656 00000100:00100000:2.0:1788832184.022020:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 371 00000100:00100000:2.0:1788832184.022026:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2395:x1875726202598656:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832184.022055:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2395:x1875726202598656:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 29us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832184.022061:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 371 00000100:00080000:3.0:1788832184.022211:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788832184.022215:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788832184.040610:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832184.040676:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832184.040748:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832184.040816:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202599040 00000100:00100000:1.0:1788832184.040827:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202599040 00000100:00100000:0.0:1788832184.040838:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202599168 00000100:00100000:0.0:1788832184.040844:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202599168 00000100:00100000:2.0:1788832184.040906:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202599296 00000100:00100000:2.0:1788832184.040910:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202599296 00000100:00100000:1.0:1788832184.041020:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:1.0:1788832184.041042:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+5:2392:x1875726202599040:12345-192.168.203.26@tcp:9:kworker.0 00000020:00000080:1.0:1788832184.041092:0:8441:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b2835371bc 00000100:00080000:1.0:1788832184.041103:0:8441:0:(import.c:65:import_set_state_nolock()) ffff9d2b076ef800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788832184.041145:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:1.0:1788832184.041383:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+2:2392:x1875726202599040:12345-192.168.203.26@tcp:9:kworker.0 Request processed in 344us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832184.041391:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 27 00010000:00010000:1.0:1788832184.041412:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832184.043127:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 241 00000100:00100000:0.0:1788832184.043140:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202599168:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832184.047063:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202599168:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 3856us (6316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832184.047079:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 241 00000100:00080000:3.0:1788832184.047679:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788832184.047685:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788832184.047690:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832184.050614:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 242 00000100:00100000:2.0:1788832184.050663:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2395:x1875726202599296:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832184.050750:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2395:x1875726202599296:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 91us (10000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832184.050758:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 242 00010000:00010000:2.0:1788832184.791085:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832185.814880:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832186.071754:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832186.071857:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218414336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788832186.071923:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832186.074100:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218414336 00000100:00100000:0.0:1788832186.074115:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218414336 00000100:00100000:0.0:1788832186.074182:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788832186.074193:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218414336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788832186.074226:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788832186.074353:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218414336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 161us (2429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832186.074360:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788832186.074491:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218414336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832186.583982:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218414464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788832186.584061:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832186.584185:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218414464 00000100:00100000:3.0:1788832186.584204:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218414464 00000100:00100000:3.0:1788832186.584259:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788832186.584270:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218414464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788832186.584306:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788832186.587572:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218414464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3297us (3503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832186.587587:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788832186.590364:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218414464:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788832186.843530:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832187.097974:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218414592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832187.098079:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832187.098144:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218414592 00000100:00100000:0.0:1788832187.098150:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218414592 00000100:00100000:0.0:1788832187.098540:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788832187.098553:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218414592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788832187.098661:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832187.098707:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218414592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832187.098715:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1788832187.098736:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788832187.099295:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc05180 x1875726218414592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832187.099317:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218414592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832187.100161:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218414976:0@lo:400:kworker.0 00000100:00100000:0.0:1788832187.100542:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218414720:0@lo:400:kworker.0 00000100:00100000:0.0:1788832187.100924:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832187.100971:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218415232:0@lo:400:kworker.0 00000100:00100000:0.0:1788832187.100995:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832187.101010:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218415744:0@lo:400:kworker.0 00000100:00100000:0.0:1788832187.101028:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832187.101047:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788832187.101053:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218414848:0@lo:400:kworker.0 00000100:00100000:0.0:1788832187.101071:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832187.101084:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218415360:0@lo:400:kworker.0 00000100:00100000:0.0:1788832187.101099:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832187.101112:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1875726218415872:0@lo:400:kworker.0 00000100:00100000:0.0:1788832187.101126:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832187.101151:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218414720 00000100:00100000:0.0:1788832187.101157:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218414720 00000100:00100000:2.0:1788832187.101308:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832187.101329:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218415488:0@lo:400:kworker.0 00000100:00100000:2.0:1788832187.101362:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832187.101380:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218416000:0@lo:400:kworker.0 00000100:00100000:2.0:1788832187.101398:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832187.101413:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788832187.101418:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218415104:0@lo:400:kworker.0 00000100:00100000:2.0:1788832187.101434:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832187.101702:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218415616:0@lo:400:kworker.0 00000100:00100000:2.0:1788832187.101726:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832187.101752:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218416128:0@lo:400:kworker.0 00000100:00100000:2.0:1788832187.101770:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832187.101796:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218415232 00000100:00100000:0.0:1788832187.102296:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1788832187.102311:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218414720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832187.102366:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218414720:12345-0@lo:400:kworker.0 Request processed in 60us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832187.102373:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788832187.102515:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218415232 00000100:00100000:2.0:1788832187.102551:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218414976 00000100:00100000:2.0:1788832187.102554:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218414976 00000100:00100000:2.0:1788832187.102919:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788832187.102926:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218415232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832187.102969:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218415232:12345-0@lo:400:kworker.0 Request processed in 44us (1974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832187.102975:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788832187.102987:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788832187.102992:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218414976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832187.103024:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218414976:12345-0@lo:400:kworker.0 Request processed in 32us (1716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832187.103029:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788832187.103045:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218414848 00000100:00100000:2.0:1788832187.103048:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218414848 00000100:00100000:2.0:1788832187.103075:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218415360 00000100:00100000:2.0:1788832187.103078:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218415360 00000100:00100000:2.0:1788832187.103095:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218415872 00000100:00100000:2.0:1788832187.103097:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218415872 00000100:00100000:2.0:1788832187.103107:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218415488 00000100:00100000:2.0:1788832187.103109:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218415488 00000100:00100000:2.0:1788832187.103118:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218416000 00000100:00100000:2.0:1788832187.103120:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218416000 00000100:00100000:2.0:1788832187.103129:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788832187.103134:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218414848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832187.103162:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218414848:12345-0@lo:400:kworker.0 Request processed in 28us (2090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832187.103168:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788832187.103361:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218415744 00000100:00100000:0.0:1788832187.103365:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218415744 00000100:00100000:0.0:1788832187.103391:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218415616 00000100:00100000:0.0:1788832187.103393:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218415616 00000100:00100000:0.0:1788832187.103406:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218416128 00000100:00100000:0.0:1788832187.103408:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218416128 00000100:00100000:0.0:1788832187.103422:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788832187.103427:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218415744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832187.103655:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218415744:12345-0@lo:400:kworker.0 Request processed in 226us (2625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832187.103667:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788832187.103680:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788832187.103686:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218415616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832187.103710:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218415616:12345-0@lo:400:kworker.0 Request processed in 25us (1983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832187.103715:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788832187.103723:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788832187.103728:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218416128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832187.103759:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218416128:12345-0@lo:400:kworker.0 Request processed in 31us (1989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832187.103764:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788832187.103782:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218415104 00000100:00100000:0.0:1788832187.103785:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218415104 00000100:00100000:2.0:1788832187.104330:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788832187.104340:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218415360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832187.104376:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218415360:12345-0@lo:400:kworker.0 Request processed in 39us (3275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832187.104381:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788832187.104393:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788832187.104399:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875726218415872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832187.104419:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875726218415872:12345-0@lo:400:kworker.0 Request processed in 20us (3292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832187.104424:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788832187.104432:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788832187.104438:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218415488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832187.104515:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788832187.104522:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218416000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832187.104549:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218416000:12345-0@lo:400:kworker.0 Request processed in 29us (3151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832187.104555:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788832187.104663:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218415488:12345-0@lo:400:kworker.0 Request processed in 225us (3301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832187.104678:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788832187.104689:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788832187.104695:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218415104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832187.104718:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218415104:12345-0@lo:400:kworker.0 Request processed in 24us (3283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832187.104723:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788832187.104940:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218414848:0@lo:400:kworker.0 00000100:00100000:0.0:1788832187.104955:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218415360:0@lo:400:kworker.0 00000100:00100000:0.0:1788832187.104966:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1875726218415872:0@lo:400:kworker.0 00000100:00100000:0.0:1788832187.104974:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218414720:0@lo:400:kworker.0 00000100:00100000:0.0:1788832187.104984:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218415232:0@lo:400:kworker.0 00000100:00100000:0.0:1788832187.105002:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218415744:0@lo:400:kworker.0 00000100:00100000:2.0:1788832187.105292:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218415104:0@lo:400:kworker.0 00000100:00100000:2.0:1788832187.105303:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218415616:0@lo:400:kworker.0 00010000:00080000:2.0:1788832187.105316:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c18fe6300 x1875726218416128/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832187.105325:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218416128:0@lo:400:kworker.0 00000100:00100000:2.0:1788832187.105335:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218414976:0@lo:400:kworker.0 00010000:00080000:2.0:1788832187.105344:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36c89500 x1875726218415488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832187.105352:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218415488:0@lo:400:kworker.0 00010000:00080000:2.0:1788832187.105362:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36c8a680 x1875726218416000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832187.105368:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218416000:0@lo:400:kworker.0 00000100:00080000:2.0:1788832187.105405:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788832187.105409:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788832187.105411:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788832187.105414:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788832187.287366:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788832187.289369:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788832187.607283:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788832187.608124:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218416256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788832187.608199:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832187.608467:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218416256 00000100:00100000:0.0:1788832187.608477:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218416256 00000100:00100000:0.0:1788832187.608533:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788832187.608543:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218416256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788832187.608567:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832187.608615:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218416256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832187.608648:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:2.0:1788832187.608746:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc04700 x1875726218416256/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832187.608764:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218416256:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788832187.865415:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832188.121080:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788832188.121105:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218416384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788832188.121173:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832188.121236:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218416384 00000100:00100000:0.0:1788832188.121243:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218416384 00000100:00100000:0.0:1788832188.121287:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788832188.121296:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218416384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788832188.121349:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832188.121656:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218416384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 359us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832188.121664:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788832188.121694:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218416384:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788832188.630966:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0767f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218416512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788832188.631061:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832188.631141:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218416512 00000100:00100000:3.0:1788832188.631149:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218416512 00000100:00100000:3.0:1788832188.631196:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788832188.631206:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218416512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788832188.631230:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832188.631273:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218416512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832188.631280:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788832188.631329:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0767f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218416512:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788832188.887969:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832189.142848:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832189.142891:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832189.142913:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832189.142930:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832189.142966:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832189.142991:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202599680 00000100:00100000:0.0:1788832189.143001:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202599680 00000100:00100000:0.0:1788832189.143056:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202599936 00000100:00100000:0.0:1788832189.143060:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202599936 00000100:00100000:0.0:1788832189.143073:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202599552 00000100:00100000:0.0:1788832189.143075:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202599552 00000100:00100000:0.0:1788832189.143085:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202599808 00000100:00100000:0.0:1788832189.143088:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202599808 00000100:00100000:0.0:1788832189.143104:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 249 00000100:00100000:0.0:1788832189.143113:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202599680:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832189.143183:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202599680:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 72us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832189.143190:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 249 00000100:00100000:0.0:1788832189.143209:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 250 00000100:00100000:0.0:1788832189.143215:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202599936:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832189.143239:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202599936:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 25us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832189.143245:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 250 00000100:00100000:0.0:1788832189.143256:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 251 00000100:00100000:0.0:1788832189.143261:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202599552:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832189.143282:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202599552:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 21us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832189.143288:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 251 00000100:00100000:0.0:1788832189.143300:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 252 00000100:00100000:0.0:1788832189.143306:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202599808:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832189.143336:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202599808:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 30us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832189.143342:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 252 00000100:00080000:0.0:1788832189.143370:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788832189.143374:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788832189.143525:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202599424 00000100:00100000:3.0:1788832189.143530:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202599424 00000100:00100000:3.0:1788832189.143577:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 373 00000100:00100000:3.0:1788832189.143587:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2396:x1875726202599424:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832189.145408:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2396:x1875726202599424:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 1811us (2567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832189.145422:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 373 00010000:00010000:0.0:1788832189.910848:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788832190.177397:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 352fff76-09db-42cd-818a-16e788a01abb 00000020:00000080:0.0:1788832190.177407:0:8434:0:(genops.c:885:class_export_put()) final put ffff9d2b076ec800/352fff76-09db-42cd-818a-16e788a01abb 00000020:00000080:2.0:1788832190.177779:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b076ec800/352fff76-09db-42cd-818a-16e788a01abb for lustre-OST0000 00000020:00000080:2.0:1788832190.177844:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2b076ef800 for lustre-OST0000 00000001:02000400:1.0:1788832190.723892:0:14063:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 21:49:49 (1788832189) 00010000:00010000:3.0:1788832190.936416:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832191.191187:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218416640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788832191.191262:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832191.191410:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218416640 00000100:00100000:2.0:1788832191.191419:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218416640 00000100:00100000:2.0:1788832191.191468:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788832191.191478:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218416640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788832191.191513:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788832191.191570:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218416640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832191.191577:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788832191.191665:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218416640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788832191.702878:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218416768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788832191.702950:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832191.703075:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218416768 00000100:00100000:2.0:1788832191.703082:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218416768 00000100:00100000:2.0:1788832191.703124:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788832191.703132:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218416768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788832191.703174:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788832191.703230:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218416768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832191.703237:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788832191.703309:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218416768:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788832191.959935:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832192.215100:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218416896:0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.215181:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832192.215239:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218417408:0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.215268:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832192.215287:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b073bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218417920:0@lo:400:kworker.0 00000100:00100000:3.0:1788832192.215303:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218417024:0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.215312:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832192.215347:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218418432:0@lo:400:kworker.0 00000100:00100000:3.0:1788832192.215348:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832192.215383:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218417536:0@lo:400:kworker.0 00000100:00100000:0.0:1788832192.215486:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218417920 00000100:00100000:0.0:1788832192.215493:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218417920 00000100:00100000:0.0:1788832192.215552:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788832192.215561:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218417920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832192.215638:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218416896 00000100:00100000:2.0:1788832192.215643:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218416896 00000100:00100000:2.0:1788832192.215674:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1788832192.215681:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3652:x1875726218416896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.216711:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832192.216766:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788832192.216778:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218417280:0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.216827:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832192.216988:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b073bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218417792:0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.217016:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832192.217041:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218418304:0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.217062:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832192.217099:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218418432 00000100:00100000:1.0:1788832192.217104:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218418432 00000100:00100000:1.0:1788832192.217138:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218417792 00000100:00100000:1.0:1788832192.217141:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218417792 00000100:00100000:1.0:1788832192.217156:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218418304 00000100:00100000:1.0:1788832192.217158:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218418304 00000100:00100000:1.0:1788832192.217174:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788832192.217181:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218418432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.217228:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218418432:12345-0@lo:400:kworker.0 Request processed in 46us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832192.217235:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788832192.217252:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788832192.217259:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218417792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.217287:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218417792:12345-0@lo:400:kworker.0 Request processed in 29us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832192.217293:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788832192.217305:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788832192.217311:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218418304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.218671:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218418304:12345-0@lo:400:kworker.0 Request processed in 1355us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832192.218682:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788832192.218966:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b073bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218417792:0@lo:400:kworker.0 00010000:00080000:1.0:1788832192.219000:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36c93b80 x1875726218418304/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832192.219011:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218418304:0@lo:400:kworker.0 00010000:00080000:1.0:1788832192.219022:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36c90700 x1875726218418432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832192.219030:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218418432:0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.219085:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218417024 00000100:00100000:1.0:1788832192.219090:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218417024 00000100:00100000:1.0:1788832192.219125:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218417280 00000100:00100000:1.0:1788832192.219128:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218417280 00000100:00100000:1.0:1788832192.219145:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788832192.219152:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218417024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.219193:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218417024:12345-0@lo:400:kworker.0 Request processed in 41us (3848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832192.219199:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788832192.219210:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788832192.219214:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218417280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.219238:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218417280:12345-0@lo:400:kworker.0 Request processed in 24us (2411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832192.219243:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788832192.219263:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218417408 00000100:00100000:1.0:1788832192.219266:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218417408 00000100:00100000:1.0:1788832192.219295:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788832192.219301:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218417408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.219329:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218417408:12345-0@lo:400:kworker.0 Request processed in 29us (4061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832192.219340:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788832192.219365:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218417280:0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.219375:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218417408:0@lo:400:kworker.0 00000100:00080000:1.0:1788832192.219412:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788832192.219416:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832192.219483:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218417152:0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.219512:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832192.219547:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218417664:0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.219565:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832192.219582:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218418176:0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.219598:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832192.219612:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832192.219617:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36da1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218418560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832192.219659:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832192.219679:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218417664 00000100:00100000:1.0:1788832192.219682:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218417664 00000100:00100000:1.0:1788832192.219702:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218418176 00000100:00100000:1.0:1788832192.219704:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218418176 00000100:00100000:1.0:1788832192.219717:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788832192.219722:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218417664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.219962:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218417664:12345-0@lo:400:kworker.0 Request processed in 239us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832192.219969:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788832192.219981:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788832192.219987:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218418176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.220019:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218418176:12345-0@lo:400:kworker.0 Request processed in 33us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832192.220025:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:1.0:1788832192.220042:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788832192.220057:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b077b9880 x1875726218417664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832192.220068:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218417664:0@lo:400:kworker.0 00010000:00080000:1.0:1788832192.220076:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36c91500 x1875726218418176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832192.220084:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218418176:0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.220119:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218418560 00000100:00100000:1.0:1788832192.220121:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218418560 00000100:00100000:1.0:1788832192.220143:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788832192.220148:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218418560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788832192.220168:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832192.220197:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218418560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832192.220203:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788832192.220215:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218417152 00000100:00100000:1.0:1788832192.220218:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218417152 00000100:00100000:1.0:1788832192.220233:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788832192.220238:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218417152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.220263:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218417152:12345-0@lo:400:kworker.0 Request processed in 24us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832192.220268:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00080000:1.0:1788832192.220297:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36da1180 x1875726218418560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832192.220311:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36da1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218418560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832192.220319:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218417152:0@lo:400:kworker.0 00000100:00100000:3.0:1788832192.222742:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832192.222828:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218418048:0@lo:400:kworker.0 00000100:00100000:3.0:1788832192.222872:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832192.222916:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218417536 00000100:00100000:3.0:1788832192.222925:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218417536 00000100:00100000:3.0:1788832192.222987:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218418048 00000100:00100000:3.0:1788832192.222991:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218418048 00000100:00100000:3.0:1788832192.223019:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788832192.223029:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0767f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218417536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832192.223087:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0767f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218417536:12345-0@lo:400:kworker.0 Request processed in 59us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832192.223113:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788832192.223132:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788832192.223139:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218418048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832192.223171:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218418048:12345-0@lo:400:kworker.0 Request processed in 33us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832192.223178:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:3.0:1788832192.223201:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832192.223232:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218418048:0@lo:400:kworker.0 00000100:00100000:3.0:1788832192.225949:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218417024:0@lo:400:kworker.0 00000100:00100000:3.0:1788832192.225969:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218417536:0@lo:400:kworker.0 00000100:00100000:0.0:1788832192.232079:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218417920:12345-0@lo:400:kworker.0 Request processed in 16507us (16754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832192.232095:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788832192.232468:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3652:x1875726218416896:12345-0@lo:400:kworker.0 Request processed in 16785us (17284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832192.232489:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1788832192.237850:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218416896:0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.237876:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b073bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218417920:0@lo:400:kworker.0 00000100:00100000:1.0:1788832192.377278:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832192.377378:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202600064 00000100:00100000:0.0:1788832192.377388:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202600064 00000100:00100000:0.0:1788832192.377482:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:0.0:1788832192.377493:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b073bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+5:11079:x1875726202600064:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788832192.377514:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832192.377592:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353729c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0463a expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832192.377687:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835372a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832192.377701:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835372a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832192.377728:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835372a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832192.377788:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788832192.377791:0:13811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788832192.377838:0:13811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835372a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832192.377862:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353729c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0463a expref: 7 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832192.377879:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835372a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0463a expref: 6 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832192.377888:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c3919da00) 00010000:00010000:0.0:1788832192.377891:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788832192.377894:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0d800, rc 0) 00000100:00100000:0.0:1788832192.377961:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b073bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+6:11079:x1875726202600064:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 469us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832192.377968:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00080000:3.0:1788832192.378354:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832192.387313:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832192.387389:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202600192 00000100:00100000:3.0:1788832192.387399:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202600192 00000100:00100000:3.0:1788832192.387481:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:3.0:1788832192.387491:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+6:11080:x1875726202600192:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832192.387513:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832192.387541:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b2835372aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04641 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.387900:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b2835372b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.387916:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b2835372b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.387928:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b2835372b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.387957:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b2835372b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.387965:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b2835372b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.387971:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b2835372b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.388042:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2000/0x998c12b2835372bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.388050:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2000/0x998c12b2835372bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.388056:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2000/0x998c12b2835372bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832192.388099:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788832192.388104:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788832192.388127:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2000/0x998c12b2835372bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.388137:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b2835372b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.388144:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b2835372b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.388151:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b2835372b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.388167:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832192.388171:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b2835372b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.388179:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b2835372b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.388192:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c3919da00) 00010000:00010000:3.0:1788832192.388195:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832192.388200:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b2835372b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.388206:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b2835372b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.388220:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b2835372b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.388225:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b2835372b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.388232:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b2835372b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.388237:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832192.388239:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b2835372b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.388244:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b2835372b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.388262:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9d2c03837500) 00010000:00010000:3.0:1788832192.388264:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832192.388267:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b2835372b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.388274:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b2835372b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.388305:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b2835372aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04641 expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.388317:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2000/0x998c12b2835372bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04641 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832192.388324:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d2c03837700) 00010000:00010000:3.0:1788832192.388326:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788832192.388328:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2000, rc 0) 00000100:00100000:3.0:1788832192.388441:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+7:11080:x1875726202600192:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 950us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832192.388449:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:2.0:1788832192.416609:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832192.417333:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202600320 00000100:00100000:3.0:1788832192.417344:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202600320 00000100:00100000:3.0:1788832192.418740:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:3.0:1788832192.418783:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:352fff76-09db-42cd-818a-16e788a01abb+7:11080:x1875726202600320:12345-192.168.203.26@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788832192.418921:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:352fff76-09db-42cd-818a-16e788a01abb+7:11080:x1875726202600320:12345-192.168.203.26@tcp:900:lhsmtool_posix.0 Request processed in 168us (2322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832192.418929:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:2.0:1788832192.427212:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832192.427317:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202600576 00000100:00100000:1.0:1788832192.427327:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202600576 00000100:00100000:1.0:1788832192.427427:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:1.0:1788832192.427438:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+7:11080:x1875726202600576:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788832192.427459:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832192.427478:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b2835372c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04648 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.427699:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835372cd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.427713:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835372cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.427723:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835372cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.427771:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835372d4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.427796:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835372d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.427804:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835372d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.427916:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfea00/0x998c12b2835372db lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.427924:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfea00/0x998c12b2835372db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.427931:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfea00/0x998c12b2835372db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832192.427940:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788832192.428024:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835372cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.428032:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835372cd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.428039:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835372cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.428044:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832192.428048:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835372cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.428056:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835372cd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.428080:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d2c03837700) 00010000:00010000:1.0:1788832192.428083:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832192.428088:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835372cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.428095:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835372cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.428109:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835372d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.428114:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835372d4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.428120:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835372d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.428126:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832192.428129:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835372d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.428135:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835372d4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.428142:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d2b073aee00) 00010000:00010000:1.0:1788832192.428145:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832192.428147:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835372d4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.428152:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835372d4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.429920:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b2835372c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04648 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.429946:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfea00/0x998c12b2835372db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04648 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832192.429955:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d2b073ae800) 00010000:00010000:1.0:1788832192.429957:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832192.429961:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfea00, rc 0) 00000100:00100000:1.0:1788832192.430154:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+9:11080:x1875726202600576:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 2716us (3177us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788832192.430174:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:1.0:1788832192.451991:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832192.452127:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202600704 00000100:00100000:3.0:1788832192.452136:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202600704 00000100:00100000:3.0:1788832192.452452:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:3.0:1788832192.452464:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+9:11080:x1875726202600704:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788832192.452901:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+9:11080:x1875726202600704:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 Request processed in 438us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832192.452908:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:2.0:1788832192.465120:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832192.465310:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202600832 00000100:00100000:3.0:1788832192.465322:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202600832 00000100:00100000:3.0:1788832192.465678:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:3.0:1788832192.465690:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:11080:x1875726202600832:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1788832192.471910:0:6525:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6178us 00000100:00080000:1.0:1788832192.472663:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788832192.499261:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:11080:x1875726202600832:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 Request processed in 33565us (34142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832192.499275:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:1.0:1788832192.733055:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218418688:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788832192.733149:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832192.733995:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218418688 00000100:00100000:1.0:1788832192.734004:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218418688 00000100:00100000:1.0:1788832192.734055:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788832192.734065:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218418688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788832192.734090:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832192.734177:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218418688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832192.734183:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:1.0:1788832192.734228:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36c8bb80 x1875726218418688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832192.734333:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218418688:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788832192.983030:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832193.239052:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218418816:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788832193.239187:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832193.239474:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218418816 00000100:00100000:1.0:1788832193.239482:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218418816 00000100:00100000:1.0:1788832193.239537:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788832193.239549:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b070b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218418816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788832193.239582:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832193.239655:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b070b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218418816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832193.239663:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788832193.239773:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218418816:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788832193.431403:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788832193.434206:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788832193.752011:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832193.752036:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c18fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218418944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788832193.752103:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832193.752167:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218418944 00000100:00100000:3.0:1788832193.752175:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218418944 00000100:00100000:3.0:1788832193.752221:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788832193.752231:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218418944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788832193.752252:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832193.752304:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218418944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832193.752312:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788832193.752379:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c18fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218418944:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788832194.014669:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832194.270814:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832194.270902:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832194.270936:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832194.270954:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832194.270982:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832194.271010:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202601216 00000100:00100000:2.0:1788832194.271019:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202601216 00000100:00100000:2.0:1788832194.271075:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202601472 00000100:00100000:2.0:1788832194.271079:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202601472 00000100:00100000:2.0:1788832194.271097:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202601088 00000100:00100000:2.0:1788832194.271099:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202601088 00000100:00100000:2.0:1788832194.271110:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202601344 00000100:00100000:2.0:1788832194.271113:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202601344 00000100:00100000:2.0:1788832194.271129:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 259 00000100:00100000:2.0:1788832194.271140:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+5:2394:x1875726202601216:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832194.271225:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+5:2394:x1875726202601216:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 86us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832194.271232:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 259 00000100:00100000:2.0:1788832194.271250:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 260 00000100:00100000:2.0:1788832194.271256:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2394:x1875726202601472:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832194.271284:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2394:x1875726202601472:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 29us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832194.271301:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 260 00000100:00100000:2.0:1788832194.271314:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 261 00000100:00100000:2.0:1788832194.271319:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+9:2394:x1875726202601088:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832194.271344:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+9:2394:x1875726202601088:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832194.271351:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 261 00000100:00100000:2.0:1788832194.271362:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 262 00000100:00100000:2.0:1788832194.271368:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2394:x1875726202601344:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832194.271390:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2394:x1875726202601344:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 22us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832194.271409:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 262 00000100:00080000:2.0:1788832194.271426:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788832194.271429:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788832194.272218:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202600960 00000100:00100000:3.0:1788832194.272228:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202600960 00000100:00100000:3.0:1788832194.272280:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 375 00000100:00100000:3.0:1788832194.272289:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2394:x1875726202600960:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832194.272466:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2394:x1875726202600960:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 177us (1672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832194.272474:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 375 00000100:00100000:3.0:1788832194.310698:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832194.310741:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202601600 00000100:00100000:1.0:1788832194.310751:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202601600 00000100:00100000:1.0:1788832194.310824:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00100000:1.0:1788832194.310835:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+9:11123:x1875726202601600:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788832194.310856:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832194.310877:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835372e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0464f expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311159:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835372f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311262:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835372f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311276:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835372f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311308:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b2835372f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311317:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b2835372f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311329:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b2835372f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311387:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835372f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311398:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835372f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311409:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835372f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311419:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfec00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832194.311427:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835372f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311438:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835372f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311522:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c3919da00) 00010000:00010000:1.0:1788832194.311527:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832194.311532:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835372f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311539:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835372f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311653:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b2835372f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311663:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b2835372f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311673:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b2835372f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311679:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832194.311685:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b2835372f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311694:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b2835372f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311706:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d2b073aee00) 00010000:00010000:1.0:1788832194.311712:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832194.311715:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b2835372f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311722:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b2835372f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311761:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835372e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0464f expref: 10 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311772:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c3919da00) 00010000:00010000:1.0:1788832194.311775:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832194.311784:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835372e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0464f expref: 10 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.311804:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe200, rc 0) 00000100:00100000:1.0:1788832194.311868:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+9:11123:x1875726202601600:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1035us (1177us total) trans 0 rc 301/301 00000100:00100000:1.0:1788832194.311876:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00100000:1.0:1788832194.320786:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832194.320855:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202601856 00000100:00100000:0.0:1788832194.320865:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202601856 00000100:00100000:0.0:1788832194.320931:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:0.0:1788832194.320942:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+9:11123:x1875726202601856:12345-192.168.203.26@tcp:36:lfs.0 00010000:00010000:0.0:1788832194.321006:0:13811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832194.321032:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835372a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0463a expref: 9 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.321048:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c3919da00) 00010000:00010000:0.0:1788832194.321058:0:13811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788832194.321115:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b2835372fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.321128:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b2835372fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.321138:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b2835372fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.321149:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b283537305 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.321156:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b283537305 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.321163:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b283537305 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.321697:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353730c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.321708:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353730c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.321715:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353730c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788832194.321741:0:13811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b053df7 reply state 000000003a65d928 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353730c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.321753:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353730c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.321760:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:0.0:1788832194.321762:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788832194.321765:0:13811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788832194.321769:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788832194.321776:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b2835372fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.321783:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b2835372fe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.321789:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b2835372fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.321804:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832194.321809:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b2835372fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.321817:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b2835372fe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.321825:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c0f9a5900) 00010000:00010000:0.0:1788832194.321828:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832194.321831:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b2835372fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.321845:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b2835372fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788832194.321857:0:13811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b053df7 reply state 000000003a65d928 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b283537305 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.321865:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b283537305 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.321872:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d2c0f9a5a00) 00010000:00010000:0.0:1788832194.321875:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788832194.321877:0:13811:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788832194.321981:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+10:11123:x1875726202601856:12345-192.168.203.26@tcp:36:lfs.0 Request processed in 1040us (1203us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788832194.321990:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:2.0:1788832194.405528:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832194.405603:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202601984 00000100:00100000:3.0:1788832194.405612:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202601984 00000100:00100000:3.0:1788832194.405829:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:3.0:1788832194.405850:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+10:11131:x1875726202601984:12345-192.168.203.26@tcp:101:lctl.0 00010000:00010000:3.0:1788832194.405880:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832194.405904:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537313 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04656 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.405975:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b28353731a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.405990:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b28353731a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.406001:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b28353731a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832194.406059:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788832194.406063:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788832194.406101:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b28353731a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.406126:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537313 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04656 expref: 12 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.406143:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b28353731a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04656 expref: 11 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.406152:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c0ad05b00) 00010000:00010000:3.0:1788832194.406155:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788832194.406158:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2400, rc 0) 00000100:00100000:3.0:1788832194.406217:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+11:11131:x1875726202601984:12345-192.168.203.26@tcp:101:lctl.0 Request processed in 378us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832194.406224:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:2.0:1788832194.480662:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832194.480775:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202602112 00000100:00100000:1.0:1788832194.480785:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202602112 00000100:00100000:1.0:1788832194.480889:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:1.0:1788832194.480900:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+11:11137:x1875726202602112:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1788832194.480920:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832194.480941:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537321 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0465d expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481005:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537328 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481020:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537328 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481032:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537328 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481043:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b28353732f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481050:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b28353732f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481075:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b28353732f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481156:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffc00/0x998c12b283537336 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481536:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffc00/0x998c12b283537336 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481545:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffc00/0x998c12b283537336 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832194.481766:0:8742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788832194.481771:0:8742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788832194.481824:0:8742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffc00/0x998c12b283537336 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481837:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537328 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481844:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537328 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481851:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537328 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481857:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfec00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832194.481860:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537328 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481868:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537328 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481891:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c0ad05b00) 00010000:00010000:1.0:1788832194.481894:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832194.481900:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537328 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481907:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537328 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481921:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b28353732f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481927:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b28353732f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481933:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b28353732f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481937:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832194.481940:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b28353732f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481945:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b28353732f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481952:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d2c0f9a5a00) 00010000:00010000:1.0:1788832194.481954:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832194.481957:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b28353732f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.481963:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b28353732f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.482004:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537321 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0465d expref: 13 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.482018:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffc00/0x998c12b283537336 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0465d expref: 12 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.482026:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:1.0:1788832194.482028:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788832194.482030:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cffc00, rc 0) 00000100:00100000:1.0:1788832194.482154:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+12:11137:x1875726202602112:12345-192.168.203.26@tcp:101:bash.0 Request processed in 1255us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832194.482171:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:3.0:1788832194.485473:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832194.485548:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202602368 00000100:00100000:0.0:1788832194.485557:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202602368 00000100:00100000:0.0:1788832194.485641:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:0.0:1788832194.485651:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+12:11137:x1875726202602368:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1788832194.485670:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832194.485688:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353733d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04664 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.485784:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537344 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.485811:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537344 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.485841:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537344 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.488128:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b28353734b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.488150:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b28353734b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.488349:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b28353734b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788832194.490109:0:13811:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788832194.490342:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537352 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.490357:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537352 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.490367:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537352 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.490467:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537344 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.490474:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537344 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.490481:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537344 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.490487:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0d800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832194.490505:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537344 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.490766:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537344 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.490778:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:0.0:1788832194.490781:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832194.490785:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537344 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.490802:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537344 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788832194.490816:0:13811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009aa4a7c8 reply state 000000004cafdb74 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b28353734b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.490827:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b28353734b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.490832:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2c0f9a5900) 00010000:00010000:0.0:1788832194.490834:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788832194.490837:0:13811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788832194.490877:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353733d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04664 expref: 15 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.490892:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537352 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04664 expref: 14 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.490899:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0f9a5e00) 00010000:00010000:0.0:1788832194.490901:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788832194.490911:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0d000, rc 0) 00000100:00100000:0.0:1788832194.491033:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+15:11137:x1875726202602368:12345-192.168.203.26@tcp:101:bash.0 Request processed in 5382us (5567us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788832194.491042:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:1.0:1788832194.496081:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832194.496164:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202602496 00000100:00100000:2.0:1788832194.496174:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202602496 00000100:00100000:2.0:1788832194.496297:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:2.0:1788832194.496305:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2392:x1875726202602496:12345-192.168.203.26@tcp:8:bash.0 00010000:00080000:2.0:1788832194.496337:0:8441:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp t0 exp 0000000000000000 cur 334 last 0 00000020:00000080:2.0:1788832194.496369:0:8441:0:(genops.c:1385:class_connect()) connect: client 352fff76-09db-42cd-818a-16e788a01abb, cookie 0x998c12b283537360 00002000:00100000:2.0:1788832194.496380:0:8441:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 352fff76-09db-42cd-818a-16e788a01abb/ffff9d2c3fc32800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788832194.496410:0:8441:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788832194.496498:0:8441:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788832194.496539:0:8441:0:(import.c:65:import_set_state_nolock()) ffff9d2c3fc30000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832194.496887:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+6:2392:x1875726202602496:12345-192.168.203.26@tcp:8:bash.0 Request processed in 311us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832194.496897:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:2.0:1788832194.502054:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832194.502285:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202602624 00000100:00100000:1.0:1788832194.502296:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202602624 00000100:00100000:1.0:1788832194.502372:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:1.0:1788832194.502382:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+6:0:x1875726202602624:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1788832194.502411:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832194.502436:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d82f700/0x998c12b283537367 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0466b expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788832194.502464:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832194.502485:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=334s v=(0 0) 00010000:00010000:1.0:1788832194.502490:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832194.502500:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d82f700/0x998c12b283537367 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0466b expref: 7 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.502553:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009d82f700/0x998c12b283537367 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0466b expref: 7 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.502568:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cff000, rc 0) 00000100:00100000:1.0:1788832194.502648:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+7:0:x1875726202602624:12345-192.168.203.26@tcp:101:bash.0 Request processed in 268us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832194.502654:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00080000:2.0:1788832194.502841:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788832194.505901:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832194.506006:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202602752 00000100:00100000:0.0:1788832194.506016:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202602752 00000100:00100000:0.0:1788832194.506077:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:0.0:1788832194.506088:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+7:11137:x1875726202602752:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1788832194.506106:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832194.506129:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ccf0c40/0x998c12b28353736e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04672 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.506160:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d82f700/0x998c12b283537367 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0466b expref: 8 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.506169:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832194.506173:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832194.506179:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ccf0c40/0x998c12b28353736e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04672 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.506216:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d82f700/0x998c12b283537367 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0466b expref: 8 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.506231:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d82f700/0x998c12b283537367 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0466b expref: 8 pid: 8442 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832194.506244:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8440:1875726218419072:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788832194.506372:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3d711180 going to sleep for 11 seconds 00000100:00100000:2.0:1788832194.510241:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8440:1875726218419072:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832194.510278:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ccf0c40/0x998c12b28353736e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04672 expref: 8 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.510298:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0d800, rc 0) 00000100:00100000:2.0:1788832194.510354:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+8:11137:x1875726202602752:12345-192.168.203.26@tcp:101:bash.0 Request processed in 4267us (4461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832194.510362:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:0.0:1788832194.510879:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832194.510978:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202602880 00000100:00100000:1.0:1788832194.510986:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202602880 00010000:00010000:1.0:1788832194.511017:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d82f700/0x998c12b283537367 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0466b expref: 8 pid: 8442 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832194.511055:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:1.0:1788832194.511065:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18e25050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:352fff76-09db-42cd-818a-16e788a01abb+8:2394:x1875726202602880:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832194.511077:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832194.511097:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d82f700/0x998c12b283537367 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0466b expref: 8 pid: 8442 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.511109:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d82f700/0x998c12b283537367 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0466b expref: 8 pid: 8442 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.511131:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d82f700/0x998c12b283537367 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0466b expref: 8 pid: 8442 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.511164:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832194.511168:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832194.511177:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ccf0c40/0x998c12b28353736e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04672 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.511187:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ccf0c40/0x998c12b28353736e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04672 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.511223:0:6512:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003ccf0c40/0x998c12b28353736e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04672 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832194.511238:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077b9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6512:1875726218419200:192.168.203.26@tcp:105: 00000100:00100000:1.0:1788832194.511296:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b0720dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788832194.519524:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832194.519680:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077b9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6512:1875726218419200:192.168.203.26@tcp:105: 00010000:00010000:1.0:1788832194.519704:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832194.519753:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18e25050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:352fff76-09db-42cd-818a-16e788a01abb+7:2394:x1875726202602880:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 8690us (8875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832194.519764:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:3.0:1788832194.520400:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202603136 00000100:00100000:3.0:1788832194.520408:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202603136 00000100:00100000:3.0:1788832194.520465:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:3.0:1788832194.520475:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+15:11137:x1875726202603136:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:3.0:1788832194.520965:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+16:11137:x1875726202603136:12345-192.168.203.26@tcp:35:bash.0 Request processed in 490us (1460us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788832194.520973:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:2.0:1788832194.616080:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832194.616178:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202603392 00000100:00100000:0.0:1788832194.616188:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202603392 00000100:00100000:0.0:1788832194.616254:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:0.0:1788832194.616265:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+16:11147:x1875726202603392:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788832194.616289:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832194.616310:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c200/0x998c12b283537375 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04679 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832194.616418:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788832194.616528:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c200/0x998c12b283537375 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04679 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.616542:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c0ad05b00) 00010000:00010000:0.0:1788832194.616545:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788832194.616549:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c200/0x998c12b283537375 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04679 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.616564:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0c200, rc 0) 00000100:00100000:0.0:1788832194.616885:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+17:11147:x1875726202603392:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 620us (812us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1788832194.616902:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:2.0:1788832194.620714:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832194.620825:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202603648 00000100:00100000:1.0:1788832194.620836:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202603648 00000100:00100000:1.0:1788832194.620896:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:1.0:1788832194.620907:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+17:11147:x1875726202603648:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1788832194.621158:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+18:11147:x1875726202603648:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 252us (455us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788832194.621199:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:1.0:1788832194.729533:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832194.730994:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202603776 00000100:00100000:2.0:1788832194.731007:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202603776 00000100:00100000:2.0:1788832194.731081:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:2.0:1788832194.731093:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+18:11153:x1875726202603776:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788832194.731116:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832194.731139:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537383 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04680 expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.731207:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b28353738a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.731235:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b28353738a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.731248:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b28353738a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832194.731296:0:8742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788832194.731300:0:8742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788832194.731323:0:8742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b28353738a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.731351:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537383 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04680 expref: 20 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.731371:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b28353738a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04680 expref: 19 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.731379:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:2.0:1788832194.731382:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788832194.731385:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031000, rc 0) 00000100:00100000:2.0:1788832194.731881:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+19:11153:x1875726202603776:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 788us (2368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832194.731897:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:2.0:1788832194.741056:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832194.741322:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202604032 00000100:00100000:0.0:1788832194.741332:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202604032 00000100:00100000:0.0:1788832194.741400:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:0.0:1788832194.741412:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+19:11153:x1875726202604032:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788832194.741450:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832194.741470:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d400/0x998c12b283537391 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04687 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.741582:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537398 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.741597:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.741610:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832194.741778:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788832194.743601:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d400/0x998c12b283537391 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04687 expref: 22 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.743651:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537398 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04687 expref: 21 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.743661:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0f9a5e00) 00010000:00010000:1.0:1788832194.743664:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832194.743668:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0c400, rc 0) 00000100:00100000:1.0:1788832194.743745:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+21:11153:x1875726202604032:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 2334us (2699us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788832194.743754:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:0.0:1788832194.752590:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832194.757852:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832194.758093:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202604288 00000100:00100000:2.0:1788832194.758105:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202604288 00000100:00100000:0.0:1788832194.758767:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202604416 00000100:00100000:0.0:1788832194.758776:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202604416 00000100:00100000:0.0:1788832194.758846:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:0.0:1788832194.758859:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+22:11153:x1875726202604416:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788832194.758891:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832194.758915:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835373a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0468e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.759024:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d400/0x998c12b2835373ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.759039:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d400/0x998c12b2835373ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.759051:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d400/0x998c12b2835373ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832194.759075:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788832194.759186:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835373a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0468e expref: 25 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.759204:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d400/0x998c12b2835373ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0468e expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.759213:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0f9a5e00) 00010000:00010000:0.0:1788832194.759215:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788832194.759218:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0d400, rc 0) 00000100:00100000:0.0:1788832194.759278:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+24:11153:x1875726202604416:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 423us (1436us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788832194.759285:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:2.0:1788832194.765517:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:2.0:1788832194.765542:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+23:2396:x1875726202604288:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832194.765577:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832194.765615:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537398 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04687 expref: 23 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.765650:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0f9a5e00) 00010000:00010000:2.0:1788832194.765654:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832194.765722:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+22:2396:x1875726202604288:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 193us (13141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832194.765730:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:1.0:1788832194.766056:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832194.767551:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202604544 00000100:00100000:3.0:1788832194.767562:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202604544 00000100:00100000:3.0:1788832194.767835:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:3.0:1788832194.767847:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+7:2393:x1875726202604544:12345-192.168.203.26@tcp:1:lfs.0 00010000:00010000:3.0:1788832194.767907:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe5d3192/0x998c12b2835373bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.767929:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ccf0c40/0x998c12b28353736e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04672 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.767939:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832194.767944:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788832194.767949:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe5d3192/0x998c12b2835373bb lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.767984:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ccf0c40/0x998c12b28353736e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04672 expref: 7 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.767998:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ccf0c40/0x998c12b28353736e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04672 expref: 7 pid: 8440 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832194.768013:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8441:1875726218419328:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788832194.768101:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c04fdb780 going to sleep for 11 seconds 00000100:00100000:2.0:1788832194.771337:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8441:1875726218419328:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832194.771368:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fe5d3192/0x998c12b2835373bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832194.774732:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832194.774838:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202604672 00000100:00100000:0.0:1788832194.774850:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202604672 00002000:00100000:0.0:1788832194.774917:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9d2c182a8700 x1875726202604672/t0(0) o4->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:135/0 lens 504/0 e 0 to 0 dl 1788832205 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788832194.774929:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2c182a8700 with x1875726202604672 ext(0->12) 00010000:00010000:0.0:1788832194.774938:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003ccf0c40/0x998c12b28353736e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04672 expref: 8 pid: 8440 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.774957:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003ccf0c40/0x998c12b28353736e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04672 expref: 8 pid: 8440 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788832194.774965:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d2c182a8700 00000100:00100000:0.0:1788832194.775001:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:0.0:1788832194.775025:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:352fff76-09db-42cd-818a-16e788a01abb+8:2393:x1875726202604672:12345-192.168.203.26@tcp:4:lfs.0 00000001:00100000:2.0:1788832194.777726:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 352fff76-09db-42cd-818a-16e788a01abb 00000100:00100000:0.0:1788832194.778580:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:352fff76-09db-42cd-818a-16e788a01abb+9:2393:x1875726202604672:12345-192.168.203.26@tcp:4:lfs.0 Request processed in 3548us (3851us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788832194.778593:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 0 00002000:00100000:0.0:1788832194.778606:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9d2c182a8700 x1875726202604672/t4294967300(0) o4->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:135/0 lens 504/448 e 0 to 0 dl 1788832205 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788832194.778651:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2c182a8700 with x1875726202604672 ext(0->12) 00010000:00010000:0.0:1788832194.778664:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003ccf0c40/0x998c12b28353736e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04672 expref: 9 pid: 8440 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.778684:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003ccf0c40/0x998c12b28353736e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04672 expref: 9 pid: 8440 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788832194.778693:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d2c182a8700 00000100:00100000:3.0:1788832194.782218:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832194.782571:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202604800 00000100:00100000:1.0:1788832194.782581:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202604800 00010000:00010000:1.0:1788832194.782717:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ccf0c40/0x998c12b28353736e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04672 expref: 9 pid: 8440 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832194.782877:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:0.0:1788832194.782899:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+9:2394:x1875726202604800:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832194.782915:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788832194.782934:0:7466:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788832194.782937:0:7466:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788832194 00002000:00010000:0.0:1788832194.782939:0:7466:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788832195 00002000:00010000:0.0:1788832194.782942:0:7466:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788832194 00002000:00010000:0.0:1788832194.782944:0:7466:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788832194.782950:0:7466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ccf0c40/0x998c12b28353736e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04672 expref: 9 pid: 8440 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.782983:0:7466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ccf0c40/0x998c12b28353736e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04672 expref: 9 pid: 8440 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.783010:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ccf0c40/0x998c12b28353736e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04672 expref: 9 pid: 8440 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.783027:0:7466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788832194.783032:0:7466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788832194.783038:0:7466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe5d3192/0x998c12b2835373bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.783048:0:7466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe5d3192/0x998c12b2835373bb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832194.783119:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832194.783190:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+8:2394:x1875726202604800:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 295us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832194.783198:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 53 00010000:00010000:3.0:1788832194.784381:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fe5d3192/0x998c12b2835373bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.784483:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe5d3192/0x998c12b2835373bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.784575:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe5d3192/0x998c12b2835373bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.784586:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe5d3192/0x998c12b2835373bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.784594:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe5d3192/0x998c12b2835373bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.784601:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2800 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:3.0:1788832194.784605:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe5d3192/0x998c12b2835373bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.784614:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe5d3192/0x998c12b2835373bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.784660:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe5d3192/0x998c12b2835373bb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.784667:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe5d3192/0x998c12b2835373bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832194.785078:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+7:2393:x1875726202604544:12345-192.168.203.26@tcp:1:lfs.0 Request processed in 17228us (19017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832194.785088:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:0.0:1788832194.788279:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832194.788378:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202605056 00000100:00100000:1.0:1788832194.788387:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202605056 00000100:00100000:1.0:1788832194.788602:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:1.0:1788832194.788614:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+22:11153:x1875726202605056:12345-192.168.203.26@tcp:35:lfs.0 00000004:00010000:1.0:1788832194.788729:0:6529:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d400/0x998c12b2835373ad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0468e expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788832194.788957:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1788832194.789007:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788832194.789314:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1788832194.789350:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835373c2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.789364:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537352 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04664 expref: 26 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.789374:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835373c2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.789485:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537352 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04664 expref: 26 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.789500:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537352 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04664 expref: 26 pid: 13811 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832194.789588:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe3ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6529:1875726218419456:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788832194.789697:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b0720d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788832194.793236:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe3ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6529:1875726218419456:192.168.203.26@tcp:104: 00010000:00010000:1.0:1788832194.793266:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835373c2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832194.794102:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832194.794216:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202605184 00000100:00100000:2.0:1788832194.794225:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202605184 00010000:00010000:2.0:1788832194.794263:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537352 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04664 expref: 27 pid: 13811 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832194.794304:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:2.0:1788832194.794314:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+27:2394:x1875726202605184:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832194.794328:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832194.794334:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537352 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04664 expref: 27 pid: 13811 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.794366:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537352 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04664 expref: 27 pid: 13811 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.794390:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537352 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04664 expref: 27 pid: 13811 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.794472:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0f9a5e00) 00010000:00010000:2.0:1788832194.794480:0:10343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835373c2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.794490:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835373c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.794497:0:10343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835373c2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.794529:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788832194.794550:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835373c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.794558:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835373c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832194.794591:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+26:2394:x1875726202605184:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 279us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832194.794599:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 54 00000001:00080000:2.0:1788832194.794764:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1788832194.794898:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1788832194.794993:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182a8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1875726218419584:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788832194.795646:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832194.795729:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376000 going to sleep for 11 seconds 00000100:00100000:1.0:1788832194.796360:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218419584 00000100:00100000:1.0:1788832194.796380:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218419584 00000100:00100000:1.0:1788832194.796763:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788832194.796775:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6529:x1875726218419584:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788832194.796921:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6529:x1875726218419584:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 149us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832194.796929:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1788832194.796978:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788832194.797030:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182a8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1875726218419584:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788832194.797221:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1788832194.797291:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc18700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1875726218419712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788832194.797328:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832194.797358:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788832194.797430:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218419712 00000100:00100000:1.0:1788832194.797436:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218419712 00000100:00100000:1.0:1788832194.797472:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788832194.797479:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6529:x1875726218419712:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788832194.797610:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6529:x1875726218419712:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 131us (281us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788832194.797617:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788832194.797669:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc18700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1875726218419712:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788832194.797713:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1788832194.797748:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835373c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.797759:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835373c2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.797767:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835373c2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.797772:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832194.797777:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835373c2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.797784:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835373c2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.797827:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0f9a5e00) 00010000:00010000:3.0:1788832194.797830:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788832194.797836:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835373c2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.797842:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835373c2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788832194.798023:0:6529:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788832194.798087:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788832194.798098:0:6529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 334838476954ns, next at 335838474934ns, rc = 0 00000001:00080000:0.0:1788832194.798104:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1788832194.798128:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0f9a5e00) 00010000:00010000:0.0:1788832194.798136:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788832194.798143:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d400/0x998c12b2835373ad lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0468e expref: 30 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832194.798252:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+29:11153:x1875726202605056:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 9640us (9982us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1788832194.798264:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 8 00000020:00080000:0.0:1788832194.798267:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788832194.804754:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832194.804894:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202605312 00000100:00100000:3.0:1788832194.804905:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202605312 00000100:00100000:3.0:1788832194.804969:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:3.0:1788832194.804980:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+29:11153:x1875726202605312:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788832194.805006:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832194.805030:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b2835373c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04695 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.805087:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b2835373c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04695 expref: 30 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.805103:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b2835373c9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04695 expref: 30 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832194.805124:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:3.0:1788832194.805127:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788832194.805131:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2800, rc 0) 00000100:00100000:3.0:1788832194.805195:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+30:11153:x1875726202605312:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 217us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832194.805202:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:1.0:1788832194.807441:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832194.807529:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202605568 00000100:00100000:3.0:1788832194.807538:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202605568 00000100:00100000:3.0:1788832194.807591:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:3.0:1788832194.807601:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18f2b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+30:11153:x1875726202605568:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788832194.807858:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18f2b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+31:11153:x1875726202605568:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 257us (424us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788832194.807866:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:2.0:1788832194.919114:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832194.920714:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202605824 00000100:00100000:1.0:1788832194.920730:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202605824 00000100:00100000:1.0:1788832194.923761:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:1.0:1788832194.923788:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+31:11163:x1875726202605824:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788832194.923834:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832194.923859:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835373d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0469c expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832194.924103:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788832194.924207:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835373d0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0469c expref: 33 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.924222:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c0ad05b00) 00010000:00010000:1.0:1788832194.924238:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788832194.924244:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835373d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0469c expref: 33 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832194.924258:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe800, rc 0) 00000100:00100000:1.0:1788832194.924395:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+32:11163:x1875726202605824:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 621us (5291us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1788832194.924404:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:1.0:1788832194.928199:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832194.928291:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202605952 00000100:00100000:2.0:1788832194.928315:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202605952 00000100:00100000:2.0:1788832194.928373:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:2.0:1788832194.928384:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+32:11163:x1875726202605952:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:2.0:1788832194.928480:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835373de lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.928498:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835373de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.928511:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835373de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.928523:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835373e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.928531:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835373e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.928537:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835373e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.928617:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b2835373ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.928771:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b2835373ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.928779:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b2835373ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788832194.928840:0:8742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b2835373ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.928865:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835373de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.928871:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835373de lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.928879:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835373de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.929101:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832194.929106:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835373de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.929114:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835373de lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.929126:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:2.0:1788832194.929129:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832194.929133:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835373de lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.929139:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835373de lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.929154:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835373e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.929160:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835373e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.929166:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835373e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.929177:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030c00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832194.929181:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835373e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.929187:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835373e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.929194:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2c0f9a5900) 00010000:00010000:2.0:1788832194.929197:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832194.929200:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835373e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.929206:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835373e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.929215:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b2835373ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.929221:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b2835373ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.929226:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b2835373ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.929231:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031e00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832194.929234:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b2835373ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.929240:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b2835373ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.929257:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:2.0:1788832194.929259:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832194.929262:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b2835373ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832194.929268:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b2835373ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832194.929352:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+32:11163:x1875726202605952:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 967us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832194.929360:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:2.0:1788832194.936354:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832194.936476:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202606208 00000100:00100000:3.0:1788832194.936487:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202606208 00000100:00100000:3.0:1788832194.936554:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:3.0:1788832194.936564:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+32:11163:x1875726202606208:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788832194.936855:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+33:11163:x1875726202606208:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 292us (511us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788832194.936863:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:0.0:1788832195.003489:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832195.003691:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202606464 00000100:00100000:3.0:1788832195.003700:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202606464 00000100:00100000:3.0:1788832195.003761:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:3.0:1788832195.003772:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+33:11166:x1875726202606464:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788832195.003821:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832195.003846:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b2835373f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc046a3 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.003933:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b2835373fa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.003950:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b2835373fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.003986:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b2835373fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004001:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537401 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004008:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537401 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004014:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537401 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004142:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537408 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004150:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537408 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004157:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537408 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832195.004180:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788832195.004258:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b2835373fa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004265:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b2835373fa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004271:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b2835373fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004277:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2a00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832195.004286:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b2835373fa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004294:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b2835373fa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004306:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:3.0:1788832195.004309:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832195.004314:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b2835373fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004319:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b2835373fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004332:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537401 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004338:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537401 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004343:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537401 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004349:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d3000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832195.004351:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537401 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004356:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537401 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004363:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2c0f9a5900) 00010000:00010000:3.0:1788832195.004365:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832195.004373:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537401 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004379:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537401 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004766:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b2835373f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046a3 expref: 36 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004783:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537408 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046a3 expref: 35 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.004814:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:3.0:1788832195.004817:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788832195.004820:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d3400, rc 0) 00000100:00100000:3.0:1788832195.004916:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+35:11166:x1875726202606464:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1145us (1436us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788832195.004924:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:1.0:1788832195.010730:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832195.010833:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202606592 00000100:00100000:0.0:1788832195.010842:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202606592 00000100:00100000:0.0:1788832195.010898:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:0.0:1788832195.010907:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+35:11166:x1875726202606592:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:0.0:1788832195.010971:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537416 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.010989:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.011001:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.011038:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.011045:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537416 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.011052:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537416 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.011073:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0dc00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832195.011078:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537416 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.011085:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537416 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.011098:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:0.0:1788832195.011101:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788832195.011105:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537416 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.011123:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537416 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832195.011201:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+35:11166:x1875726202606592:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 294us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832195.011209:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:1.0:1788832195.016425:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832195.016590:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202606848 00000100:00100000:3.0:1788832195.016601:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202606848 00000100:00100000:3.0:1788832195.016694:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:3.0:1788832195.016704:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fdab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+35:11166:x1875726202606848:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788832195.016960:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fdab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+36:11166:x1875726202606848:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 256us (545us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788832195.016968:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 11 00010000:00010000:0.0:1788832195.032400:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832195.319694:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832195.319804:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202607104 00000100:00100000:2.0:1788832195.319813:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202607104 00000100:00100000:2.0:1788832195.319878:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:2.0:1788832195.319888:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fda9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+36:11197:x1875726202607104:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:2.0:1788832195.319912:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832195.319935:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b28353741d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc046aa expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832195.320051:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537424 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832195.320067:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832195.320079:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832195.320121:0:8742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788832195.320255:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b28353741d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046aa expref: 39 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832195.320275:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537424 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046aa expref: 38 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832195.320283:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:2.0:1788832195.320286:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832195.320289:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00030c00, rc 0) 00000100:00100000:2.0:1788832195.320356:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fda9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+38:11197:x1875726202607104:12345-192.168.203.26@tcp:101:cat.0 Request processed in 470us (672us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788832195.320364:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:1.0:1788832195.325254:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832195.325298:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832195.325372:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202607488 00000100:00100000:2.0:1788832195.325394:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202607488 00000100:00100000:2.0:1788832195.325466:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:2.0:1788832195.325476:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fdaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+38:2393:x1875726202607488:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832195.325492:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832195.325519:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537424 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046aa expref: 38 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832195.325550:0:10344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:2.0:1788832195.325556:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832195.325610:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fdaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+37:2393:x1875726202607488:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 136us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832195.325645:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:3.0:1788832195.325734:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202607360 00000100:00100000:3.0:1788832195.325738:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202607360 00000100:00100000:3.0:1788832195.325780:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:3.0:1788832195.325799:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fdaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+37:11197:x1875726202607360:12345-192.168.203.26@tcp:35:cat.0 00000100:00100000:3.0:1788832195.326296:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fdaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+38:11197:x1875726202607360:12345-192.168.203.26@tcp:35:cat.0 Request processed in 506us (1049us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1788832195.326303:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:1.0:1788832195.389512:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832195.389831:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202607744 00000100:00100000:0.0:1788832195.389843:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202607744 00000100:00100000:0.0:1788832195.389918:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:0.0:1788832195.389928:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fda8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+38:11203:x1875726202607744:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:0.0:1788832195.389952:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832195.389955:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788832195.389982:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b28353738a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04680 expref: 38 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.390020:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:0.0:1788832195.390025:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788832195.390039:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537432 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc046b1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.390158:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537439 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.390172:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537408 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046a3 expref: 38 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.390180:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537439 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.390213:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537408 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046a3 expref: 38 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.390226:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537408 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046a3 expref: 38 pid: 6526 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832195.390239:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcbaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1875726218419840:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788832195.390332:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0a0e9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788832195.392589:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832195.392735:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcbaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1875726218419840:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788832195.392763:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537439 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832195.393893:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202607872 00000100:00100000:2.0:1788832195.393904:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202607872 00010000:00010000:2.0:1788832195.393951:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537408 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046a3 expref: 39 pid: 6526 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832195.394562:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:2.0:1788832195.394575:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fda8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+39:2394:x1875726202607872:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832195.394594:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832195.394602:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537408 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046a3 expref: 39 pid: 6526 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832195.394617:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537408 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046a3 expref: 39 pid: 6526 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832195.394691:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537408 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046a3 expref: 39 pid: 6526 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832195.394709:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:2.0:1788832195.394714:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537439 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832195.394722:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537439 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832195.394730:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537439 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832195.394759:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788832195.394780:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537439 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.394821:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537439 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832195.394829:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fda8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+38:2394:x1875726202607872:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 256us (2246us total) trans 0 rc 0/0 00000004:00200000:0.0:1788832195.394845:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000100:00100000:2.0:1788832195.394849:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 55 00010000:00010000:0.0:1788832195.395037:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537432 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046b1 expref: 39 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.395052:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537439 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046b1 expref: 38 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.395060:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:0.0:1788832195.395063:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788832195.395065:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0d200, rc 0) 00000100:00100000:0.0:1788832195.395089:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fda8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+38:11203:x1875726202607744:12345-192.168.203.26@tcp:101:dd.0 Request processed in 5164us (5591us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788832195.395095:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:1.0:1788832195.401944:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832195.402030:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202608000 00000100:00100000:3.0:1788832195.402039:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202608000 00000100:00100000:3.0:1788832195.402103:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:3.0:1788832195.402113:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fda9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+38:11203:x1875726202608000:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:3.0:1788832195.402137:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832195.402359:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537447 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc046b8 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.402409:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353744e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.402424:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353744e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.402436:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353744e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.402565:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537447 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046b8 expref: 40 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.402584:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353744e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046b8 expref: 39 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.402592:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:3.0:1788832195.402595:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788832195.402606:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d3000, rc 0) 00000100:00100000:3.0:1788832195.402739:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fda9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+39:11203:x1875726202608000:12345-192.168.203.26@tcp:101:dd.0 Request processed in 627us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832195.402747:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:1.0:1788832195.405610:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832195.405781:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202608256 00000100:00100000:3.0:1788832195.405800:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202608256 00000100:00100000:3.0:1788832195.405862:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 62 00000100:00100000:3.0:1788832195.405875:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fdabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+39:11203:x1875726202608256:12345-192.168.203.26@tcp:36:dd.0 00010000:00010000:3.0:1788832195.406116:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537455 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.406134:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537455 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.406145:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537455 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788832195.406186:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1788832195.406209:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d97635df reply state 00000000cbd7a7a5 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537455 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.406221:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537455 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.406228:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:3.0:1788832195.406231:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788832195.406235:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788832195.406379:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fdabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+42:11203:x1875726202608256:12345-192.168.203.26@tcp:36:dd.0 Request processed in 505us (778us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1788832195.406387:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 62 00000020:00080000:3.0:1788832195.406392:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788832195.695835:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832195.695939:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202608384 00000100:00100000:0.0:1788832195.695950:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202608384 00000100:00100000:0.0:1788832195.696018:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:0.0:1788832195.696028:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fdab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+42:11217:x1875726202608384:12345-192.168.203.26@tcp:101:stat.0 00010000:00010000:0.0:1788832195.696055:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832195.696079:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b28353745c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc046bf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.696156:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537463 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.696188:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537463 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.696201:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537463 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.696214:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b28353746a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.696222:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b28353746a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.696228:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b28353746a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.696312:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537471 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.696323:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537439 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046b1 expref: 43 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.696331:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537471 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.696364:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537439 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046b1 expref: 43 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.696377:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537439 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046b1 expref: 43 pid: 6525 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832195.696416:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcbaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1875726218419968:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788832195.696836:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0a0e9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788832195.703334:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832195.703480:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202608640 00000100:00100000:1.0:1788832195.703491:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202608640 00000100:00100000:1.0:1788832195.703551:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:1.0:1788832195.703561:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+44:6166:x1875726202608640:12345-192.168.203.26@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788832195.704077:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+45:6166:x1875726202608640:12345-192.168.203.26@tcp:35:ldlm_bl.0 Request processed in 516us (750us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788832195.704085:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:2.0:1788832195.704833:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcbaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1875726218419968:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832195.704864:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537471 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832195.708094:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832195.708270:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202608768 00000100:00100000:2.0:1788832195.708281:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202608768 00010000:00010000:2.0:1788832195.708320:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537439 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046b1 expref: 45 pid: 6525 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832195.708481:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:2.0:1788832195.708492:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fda9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+45:2394:x1875726202608768:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832195.708509:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832195.708517:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537439 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046b1 expref: 45 pid: 6525 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832195.708530:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537439 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046b1 expref: 45 pid: 6525 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832195.708556:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537439 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046b1 expref: 45 pid: 6525 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832195.709316:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:2.0:1788832195.709322:0:10343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537471 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832195.709458:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537471 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832195.709479:0:10343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537471 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832195.709568:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832195.709663:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fda9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+44:2394:x1875726202608768:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 1171us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832195.709672:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 56 00010000:00010000:0.0:1788832195.711032:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537471 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.711047:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537471 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832195.711163:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788832195.711167:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788832195.711214:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537471 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.711229:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537471 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.711239:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537463 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.711245:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537463 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.711251:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537463 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.711257:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832195.711261:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537463 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.711285:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537463 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.711299:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:0.0:1788832195.711302:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832195.711306:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537463 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.711312:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537463 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.711326:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b28353746a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.711342:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b28353746a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.711348:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b28353746a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.711353:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0ca00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832195.711355:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b28353746a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.711360:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b28353746a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.711367:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2c0f9a5900) 00010000:00010000:0.0:1788832195.711369:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832195.711372:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b28353746a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.711387:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b28353746a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.711733:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b28353745c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046bf expref: 44 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.711748:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537471 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046bf expref: 43 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.711755:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:0.0:1788832195.711757:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788832195.711759:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0dc00, rc 0) 00000100:00100000:0.0:1788832195.711902:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fdab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+43:11217:x1875726202608384:12345-192.168.203.26@tcp:101:stat.0 Request processed in 15874us (16074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832195.711923:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:1.0:1788832195.814724:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832195.814837:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202609024 00000100:00100000:3.0:1788832195.814851:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202609024 00000100:00100000:3.0:1788832195.814923:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:3.0:1788832195.814935:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fdaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+43:11222:x1875726202609024:12345-192.168.203.26@tcp:36:truncate.0 00010000:00010000:3.0:1788832195.814996:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832195.815022:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537471 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046bf expref: 43 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.815041:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:3.0:1788832195.815045:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788832195.815221:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537478 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.815236:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537478 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.815246:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537478 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788832195.815310:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1788832195.815333:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4822a6d reply state 00000000dbc40628 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537478 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.815346:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537478 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832195.815352:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:3.0:1788832195.815356:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788832195.815358:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788832195.815480:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fdaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+45:11222:x1875726202609024:12345-192.168.203.26@tcp:36:truncate.0 Request processed in 546us (766us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788832195.815498:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 64 00000020:00080000:3.0:1788832195.815504:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788832195.953334:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832195.953545:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202609152 00000100:00100000:0.0:1788832195.953568:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202609152 00000100:00100000:0.0:1788832195.953665:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:0.0:1788832195.953676:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fdab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+45:11237:x1875726202609152:12345-192.168.203.26@tcp:101:stat.0 00010000:00010000:0.0:1788832195.953699:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832195.953720:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b28353747f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc046c6 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.953800:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537486 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.953815:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537486 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.953842:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537486 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.953854:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353748d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.953861:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353748d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.953868:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353748d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.953952:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537494 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.953963:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537494 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.953970:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537494 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832195.954018:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788832195.954023:0:13811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788832195.954045:0:13811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537494 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.954057:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537494 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.954066:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537486 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.954082:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537486 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.954090:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537486 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.954096:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0ca00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832195.954101:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537486 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.954108:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537486 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.954122:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:0.0:1788832195.954125:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832195.954131:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537486 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.954137:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537486 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.954151:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353748d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.954157:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353748d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.954163:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353748d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.954168:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832195.954179:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353748d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.954185:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353748d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.954193:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2c0f9a5900) 00010000:00010000:0.0:1788832195.954195:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832195.954198:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353748d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.954204:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353748d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.954231:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b28353747f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046c6 expref: 47 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.954244:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537494 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046c6 expref: 46 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832195.954251:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:0.0:1788832195.954254:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788832195.954256:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0d000, rc 0) 00000100:00100000:0.0:1788832195.954339:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fdab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+46:11237:x1875726202609152:12345-192.168.203.26@tcp:101:stat.0 Request processed in 665us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832195.954347:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 65 00010000:00010000:0.0:1788832196.055147:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832196.073196:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832196.074122:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202609408 00000100:00100000:0.0:1788832196.074134:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202609408 00000100:00100000:1.0:1788832196.074690:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:1.0:1788832196.074705:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fda8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+46:11247:x1875726202609408:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788832196.074728:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832196.074751:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353749b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc046cd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832196.074869:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788832196.074969:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353749b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046cd expref: 48 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.074983:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c0ad05b00) 00010000:00010000:1.0:1788832196.074987:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788832196.074992:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353749b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046cd expref: 48 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.075007:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfee00, rc 0) 00000100:00100000:1.0:1788832196.075124:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fda8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+47:11247:x1875726202609408:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 423us (1944us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1788832196.075131:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00080000:2.0:1788832196.075202:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832196.079680:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832196.079770:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202609664 00000100:00100000:3.0:1788832196.079780:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202609664 00000100:00100000:3.0:1788832196.079875:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:3.0:1788832196.079885:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fda8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+47:11247:x1875726202609664:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788832196.080118:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fda8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+48:11247:x1875726202609664:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 233us (445us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1788832196.080126:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:0.0:1788832196.174992:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832196.175115:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202609920 00000100:00100000:3.0:1788832196.175126:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202609920 00000100:00100000:3.0:1788832196.175197:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:3.0:1788832196.175208:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+48:11253:x1875726202609920:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788832196.175235:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832196.175270:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b2835374a9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc046d4 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832196.175407:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835374b0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832196.175423:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537494 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046c6 expref: 49 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832196.175432:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835374b0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832196.175467:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537494 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046c6 expref: 49 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832196.175487:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537494 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046c6 expref: 49 pid: 13811 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832196.175501:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc19880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1875726218420096:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788832196.175658:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b4540 going to sleep for 11 seconds 00000100:00100000:3.0:1788832196.181604:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc19880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1875726218420096:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788832196.181841:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835374b0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832196.184608:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832196.184946:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202610048 00000100:00100000:2.0:1788832196.184957:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202610048 00010000:00010000:2.0:1788832196.185003:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537494 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046c6 expref: 50 pid: 13811 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832196.185073:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:2.0:1788832196.185084:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18e26450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+50:2393:x1875726202610048:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832196.185098:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832196.185105:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537494 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046c6 expref: 50 pid: 13811 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.185118:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537494 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046c6 expref: 50 pid: 13811 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.185139:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b283537494 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046c6 expref: 50 pid: 13811 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.185154:0:10344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:2.0:1788832196.185159:0:10344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835374b0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.185181:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835374b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.185189:0:10344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835374b0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.185256:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832196.185346:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18e26450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+49:2393:x1875726202610048:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 264us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832196.185353:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 57 00010000:00010000:3.0:1788832196.186975:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835374b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832196.186989:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835374b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832196.187012:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788832196.187159:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b2835374a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046d4 expref: 50 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832196.187180:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835374b0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046d4 expref: 49 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832196.187188:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:3.0:1788832196.187190:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788832196.187194:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dc000, rc 0) 00000100:00100000:3.0:1788832196.187403:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+49:11253:x1875726202609920:12345-192.168.203.26@tcp:101:bash.0 Request processed in 12195us (12420us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788832196.187423:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:0.0:1788832196.195234:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832196.195574:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202610304 00000100:00100000:2.0:1788832196.195584:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202610304 00000100:00100000:2.0:1788832196.195833:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:2.0:1788832196.195844:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+49:11253:x1875726202610304:12345-192.168.203.26@tcp:36:bash.0 00010000:00010000:2.0:1788832196.196076:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835374be lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.196095:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835374be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.196107:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835374be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788832196.196142:0:8742:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1788832196.196157:0:8742:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e524370f reply state 00000000fb9a50fd transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835374be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.196166:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835374be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.196185:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:2.0:1788832196.196188:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788832196.196190:0:8742:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788832196.196503:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+52:11253:x1875726202610304:12345-192.168.203.26@tcp:36:bash.0 Request processed in 660us (1278us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788832196.196511:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 68 00000020:00080000:2.0:1788832196.196517:0:8742:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788832196.201720:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832196.202378:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202610432 00000100:00100000:1.0:1788832196.202388:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202610432 00000100:00100000:1.0:1788832196.202535:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:1.0:1788832196.202708:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0777b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+52:11253:x1875726202610432:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1788832196.202744:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832196.202763:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b2835374c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc046db expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.202855:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835374cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.202870:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835374b0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046d4 expref: 53 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.202879:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835374cc lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.202976:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835374b0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046d4 expref: 53 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.202989:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835374b0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046d4 expref: 53 pid: 6526 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832196.203003:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fdaa300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1875726218420224:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788832196.203131:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b0720d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788832196.210555:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832196.212497:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202610560 00000100:00100000:0.0:1788832196.212510:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202610560 00010000:00010000:0.0:1788832196.212558:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835374b0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046d4 expref: 54 pid: 6526 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832196.212729:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fdaa300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1875726218420224:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832196.212754:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835374cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832196.212763:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:0.0:1788832196.212775:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fda8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+54:2393:x1875726202610560:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832196.212802:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832196.212809:0:7466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835374b0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046d4 expref: 54 pid: 6526 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832196.212823:0:7466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835374b0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046d4 expref: 54 pid: 6526 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832196.212846:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835374b0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046d4 expref: 54 pid: 6526 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832196.212862:0:7466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:0.0:1788832196.212867:0:7466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835374cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832196.212876:0:7466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835374cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832196.212884:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835374cc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832196.212934:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832196.212985:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fda8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+53:2393:x1875726202610560:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 212us (2438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832196.212993:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 58 00010000:00010000:2.0:1788832196.213057:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835374cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.213065:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835374cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832196.213114:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788832196.213118:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788832196.213135:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835374cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.213170:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b2835374c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046db expref: 53 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.213184:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835374cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046db expref: 52 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.213192:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:2.0:1788832196.213200:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832196.213203:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe200, rc 0) 00000100:00100000:2.0:1788832196.213225:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0777b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+52:11253:x1875726202610432:12345-192.168.203.26@tcp:101:bash.0 Request processed in 10524us (11516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832196.213232:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:2.0:1788832196.218823:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832196.218922:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202610816 00000100:00100000:1.0:1788832196.218932:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202610816 00000100:00100000:1.0:1788832196.218993:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:1.0:1788832196.219004:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18f28850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+52:11253:x1875726202610816:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:1.0:1788832196.219459:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18f28850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+53:11253:x1875726202610816:12345-192.168.203.26@tcp:35:bash.0 Request processed in 454us (644us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788832196.219486:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:1.0:1788832196.311083:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c04dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218420352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788832196.311168:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832196.311303:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218420352 00000100:00100000:3.0:1788832196.311312:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218420352 00000100:00100000:3.0:1788832196.311369:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788832196.311379:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fdab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218420352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788832196.311413:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788832196.311472:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fdab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218420352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832196.311480:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788832196.311892:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832196.311955:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c04dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218420352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788832196.312029:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202611072 00000100:00100000:1.0:1788832196.312035:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202611072 00000100:00100000:1.0:1788832196.312079:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 70 00000100:00100000:1.0:1788832196.312087:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+53:11263:x1875726202611072:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788832196.312103:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832196.312123:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835374d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc046e2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832196.312215:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788832196.312316:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835374d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046e2 expref: 55 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.312331:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c0ad05b00) 00010000:00010000:1.0:1788832196.312334:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788832196.312339:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835374d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046e2 expref: 55 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.312353:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfec00, rc 0) 00000100:00100000:1.0:1788832196.312400:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+54:11263:x1875726202611072:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 314us (510us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1788832196.312408:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 70 00000100:00100000:2.0:1788832196.314956:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832196.315047:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202611200 00000100:00100000:1.0:1788832196.315056:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202611200 00000100:00100000:1.0:1788832196.315131:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00100000:1.0:1788832196.315142:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+54:11263:x1875726202611200:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:1.0:1788832196.315215:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835374e1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315231:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835374e1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315243:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835374e1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315299:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835374e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315307:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835374e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315314:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835374e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315414:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835374ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315424:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835374ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315431:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835374ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788832196.315477:0:8742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835374ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315489:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835374e1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315513:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835374e1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315520:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835374e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315526:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfee00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832196.315530:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835374e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315538:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835374e1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315551:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:1.0:1788832196.315554:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832196.315559:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835374e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315565:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835374e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315580:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835374e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315586:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835374e8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315592:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835374e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315596:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832196.315605:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835374e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315611:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835374e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315645:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2c0f9a5900) 00010000:00010000:1.0:1788832196.315648:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832196.315651:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835374e8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315658:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b2835374e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315668:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835374ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315674:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835374ef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315680:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835374ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315685:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832196.315687:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835374ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315692:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835374ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315699:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:1.0:1788832196.315701:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832196.315711:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835374ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.315716:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835374ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832196.315798:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+54:11263:x1875726202611200:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 656us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832196.315807:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00100000:2.0:1788832196.318227:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832196.318299:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202611456 00000100:00100000:3.0:1788832196.318308:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202611456 00000100:00100000:3.0:1788832196.318400:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:3.0:1788832196.318410:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+54:11263:x1875726202611456:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788832196.318646:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+55:11263:x1875726202611456:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 210us (398us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788832196.318655:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:3.0:1788832196.368747:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832196.368845:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202611712 00000100:00100000:2.0:1788832196.368856:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202611712 00000100:00100000:2.0:1788832196.368977:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:2.0:1788832196.368989:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+55:11266:x1875726202611712:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788832196.369013:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832196.369033:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835374f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc046e9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369109:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b2835374fd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369125:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b2835374fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369137:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b2835374fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369148:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537504 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369155:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369180:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369289:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b28353750b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369298:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b28353750b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369307:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b28353750b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832196.369317:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788832196.369392:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b2835374fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369400:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b2835374fd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369407:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b2835374fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369413:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031c00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832196.369417:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b2835374fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369425:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b2835374fd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369436:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:2.0:1788832196.369439:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832196.369451:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b2835374fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369457:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b2835374fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369471:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537504 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369477:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537504 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369482:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537504 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369487:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832196.369490:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537504 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369495:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537504 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369504:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2c0f9a5900) 00010000:00010000:2.0:1788832196.369506:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832196.369509:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537504 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369514:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537504 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369550:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835374f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046e9 expref: 58 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369577:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b28353750b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046e9 expref: 57 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.369585:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:2.0:1788832196.369587:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832196.369589:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031e00, rc 0) 00000100:00100000:2.0:1788832196.369884:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+57:11266:x1875726202611712:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 896us (1157us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788832196.369893:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:2.0:1788832196.372653:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832196.372733:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202611840 00000100:00100000:3.0:1788832196.372743:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202611840 00000100:00100000:3.0:1788832196.372803:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 73 00000100:00100000:3.0:1788832196.372813:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+57:11266:x1875726202611840:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:3.0:1788832196.372879:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537519 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832196.372896:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537519 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832196.372919:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537519 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832196.372955:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537519 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832196.372962:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537519 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832196.372969:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537519 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832196.372975:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832196.372979:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537519 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832196.372987:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537519 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832196.372999:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:3.0:1788832196.373002:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788832196.373007:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537519 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832196.373013:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537519 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832196.373089:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+57:11266:x1875726202611840:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 277us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832196.373096:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 73 00000100:00100000:3.0:1788832196.373521:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832196.374070:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202611968 00000100:00100000:1.0:1788832196.374078:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202611968 00000100:00100000:1.0:1788832196.374165:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:1.0:1788832196.374175:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:352fff76-09db-42cd-818a-16e788a01abb+57:2394:x1875726202611968:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832196.374189:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832196.374209:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b28353750b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046e9 expref: 57 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.374229:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:1.0:1788832196.374233:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832196.374285:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:352fff76-09db-42cd-818a-16e788a01abb+56:2394:x1875726202611968:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 111us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832196.374292:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:3.0:1788832196.378165:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832196.378250:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202612224 00000100:00100000:1.0:1788832196.378259:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202612224 00000100:00100000:1.0:1788832196.378312:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:1.0:1788832196.378324:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+56:11266:x1875726202612224:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1788832196.378527:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+57:11266:x1875726202612224:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 205us (371us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788832196.378551:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:3.0:1788832196.555102:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832196.555332:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202612480 00000100:00100000:0.0:1788832196.555342:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202612480 00000100:00100000:0.0:1788832196.555408:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 74 00000100:00100000:0.0:1788832196.555418:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+57:11284:x1875726202612480:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:0.0:1788832196.555445:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832196.555468:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c200/0x998c12b283537520 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc046f0 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832196.555571:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537527 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832196.555586:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537527 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832196.555598:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537527 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832196.555608:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788832196.555763:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c200/0x998c12b283537520 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046f0 expref: 60 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832196.555791:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537527 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046f0 expref: 59 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832196.555807:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:0.0:1788832196.555810:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788832196.555814:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0c400, rc 0) 00000100:00100000:0.0:1788832196.555886:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+59:11284:x1875726202612480:12345-192.168.203.26@tcp:101:cat.0 Request processed in 468us (793us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1788832196.555893:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 74 00000100:00100000:0.0:1788832196.591575:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832196.594521:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202612608 00000100:00100000:2.0:1788832196.594538:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202612608 00000100:00100000:2.0:1788832196.594647:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75 00000100:00100000:2.0:1788832196.594659:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+59:11285:x1875726202612608:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788832196.594683:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832196.594705:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537535 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc046f7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.594772:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b28353753c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.594798:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b28353753c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.594811:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b28353753c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832196.594891:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788832196.594895:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788832196.594920:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b28353753c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.594947:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537535 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046f7 expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.594967:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b28353753c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046f7 expref: 60 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.594976:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:2.0:1788832196.594979:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788832196.594983:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031600, rc 0) 00000100:00100000:2.0:1788832196.595061:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+60:11285:x1875726202612608:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 405us (3493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832196.595068:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75 00000100:00100000:3.0:1788832196.601363:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832196.601463:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202612992 00000100:00100000:1.0:1788832196.601474:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202612992 00000100:00100000:1.0:1788832196.601545:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:1.0:1788832196.601555:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+60:11285:x1875726202612992:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1788832196.601890:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+61:11285:x1875726202612992:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 334us (536us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788832196.601899:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:0.0:1788832196.603967:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832196.604059:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202613120 00000100:00100000:2.0:1788832196.604068:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202613120 00000100:00100000:2.0:1788832196.604131:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:2.0:1788832196.604142:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+61:11285:x1875726202613120:12345-192.168.203.26@tcp:103:lfs.0 00010000:00010000:2.0:1788832196.604156:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788832196.604181:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835374cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046db expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.604204:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537527 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046f0 expref: 60 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.604236:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b2835373c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04695 expref: 59 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832196.604246:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:2.0:1788832196.604250:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832196.604304:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+58:11285:x1875726202613120:12345-192.168.203.26@tcp:103:lfs.0 Request processed in 164us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832196.604311:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:0.0:1788832196.609101:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832196.609201:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202613248 00000100:00100000:1.0:1788832196.609211:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202613248 00000100:00100000:1.0:1788832196.609273:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 76 00000100:00100000:1.0:1788832196.609283:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+58:11285:x1875726202613248:12345-192.168.203.26@tcp:58:lfs.0 00010000:00010000:1.0:1788832196.609416:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537543 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.609433:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537543 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.609446:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537543 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788832196.609706:0:8742:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788832196.609920:0:8742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788832196.610043:0:8742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788832196.610144:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+58:11285:x1875726202613248:12345-192.168.203.26@tcp:58:lfs.0 Request processed in 858us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832196.610152:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 76 00000100:00100000:0.0:1788832196.638110:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832196.638203:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202613376 00000100:00100000:1.0:1788832196.638212:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202613376 00000100:00100000:1.0:1788832196.638269:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 77 00000100:00100000:1.0:1788832196.638278:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+58:11287:x1875726202613376:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788832196.638298:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832196.638317:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353754a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc046fe expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638387:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537551 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638401:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537551 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638413:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537551 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638423:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537558 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638430:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638435:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638515:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b28353755f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638523:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b28353755f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638546:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b28353755f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832196.638584:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788832196.638588:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788832196.638603:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b28353755f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638615:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b28353755f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638651:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537551 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638657:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537551 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638662:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537551 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638668:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfee00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832196.638672:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537551 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638679:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537551 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638690:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:1.0:1788832196.638694:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832196.638698:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537551 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638714:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537551 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638727:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537558 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638734:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537558 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638739:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537558 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638743:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfec00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832196.638746:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537558 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638751:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537558 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638759:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2c0f9a5900) 00010000:00010000:1.0:1788832196.638761:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832196.638764:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537558 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638769:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537558 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638805:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353754a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046fe expref: 60 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638818:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b28353755f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046fe expref: 59 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832196.638832:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:1.0:1788832196.638834:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788832196.638837:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe800, rc 0) 00000100:00100000:1.0:1788832196.638901:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+59:11287:x1875726202613376:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 624us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832196.638909:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 77 00000100:00100000:2.0:1788832196.824252:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c04dc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218420480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788832196.824325:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832196.824422:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218420480 00000100:00100000:3.0:1788832196.824429:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218420480 00000100:00100000:3.0:1788832196.824485:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788832196.824494:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218420480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788832196.824529:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446268928 avail 1300029440 00000100:00100000:3.0:1788832196.824981:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218420480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 485us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832196.824989:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788832196.825274:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c04dc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218420480:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788832197.079989:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788832197.339855:0:10093:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337380230577ns, next at 338380227173ns, rc = 0 00000100:00100000:2.0:1788832197.339879:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832197.339900:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218420608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832197.339964:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832197.340024:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218420608 00000100:00100000:2.0:1788832197.340031:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218420608 00000100:00100000:2.0:1788832197.340084:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788832197.340093:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875726218420608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788832197.340121:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788832197.340163:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875726218420608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832197.340169:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1788832197.340196:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788832197.340234:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218420608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832197.343498:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218421120:0@lo:400:kworker.0 00000100:00100000:0.0:1788832197.343564:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832197.343606:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218421632:0@lo:400:kworker.0 00000100:00100000:2.0:1788832197.343650:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218420992:0@lo:400:kworker.0 00000100:00100000:0.0:1788832197.343659:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832197.343680:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832197.343692:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218422144:0@lo:400:kworker.0 00000100:00100000:2.0:1788832197.343697:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218421504:0@lo:400:kworker.0 00000100:00100000:2.0:1788832197.343714:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832197.343714:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832197.343734:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218422016:0@lo:400:kworker.0 00000100:00100000:0.0:1788832197.343741:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788832197.343747:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218420736:0@lo:400:kworker.0 00000100:00100000:2.0:1788832197.343753:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832197.343868:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218421120 00000100:00100000:1.0:1788832197.343875:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218421120 00000100:00100000:1.0:1788832197.344039:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218421504 00000100:00100000:1.0:1788832197.344044:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218421504 00000100:00100000:1.0:1788832197.344072:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218422016 00000100:00100000:1.0:1788832197.344076:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218422016 00000100:00100000:1.0:1788832197.344092:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788832197.344101:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218421120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832197.348076:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788832197.348096:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875726218420864:0@lo:400:kworker.0 00000100:00100000:2.0:1788832197.348162:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832197.348178:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218421376:0@lo:400:kworker.0 00000100:00100000:2.0:1788832197.348200:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832197.348212:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1875726218421888:0@lo:400:kworker.0 00000100:00100000:2.0:1788832197.348231:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832197.348262:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218420992 00000100:00100000:2.0:1788832197.348270:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218420992 00000100:00100000:2.0:1788832197.348325:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788832197.348334:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218420992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832197.348466:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218420992:12345-0@lo:400:kworker.0 Request processed in 132us (4783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832197.348473:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788832197.348815:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218420864 00000100:00100000:2.0:1788832197.348819:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218420864 00000100:00100000:2.0:1788832197.348837:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218421376 00000100:00100000:2.0:1788832197.348839:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218421376 00000100:00100000:2.0:1788832197.348859:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218421888 00000100:00100000:2.0:1788832197.348861:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218421888 00000100:00100000:2.0:1788832197.348875:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788832197.348881:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218421504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832197.348917:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218421504:12345-0@lo:400:kworker.0 Request processed in 36us (5201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832197.348923:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788832197.348936:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788832197.348942:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218422016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832197.348969:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218422016:12345-0@lo:400:kworker.0 Request processed in 27us (5215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832197.348974:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788832197.348986:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788832197.348992:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875726218420864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832197.349016:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875726218420864:12345-0@lo:400:kworker.0 Request processed in 24us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832197.349021:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788832197.349031:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788832197.349036:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218421376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832197.349059:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218421376:12345-0@lo:400:kworker.0 Request processed in 24us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832197.349064:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788832197.349074:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788832197.349079:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875726218421888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832197.349103:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875726218421888:12345-0@lo:400:kworker.0 Request processed in 24us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832197.349113:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788832197.349641:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832197.350079:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218421248:0@lo:400:kworker.0 00000100:00100000:0.0:1788832197.350120:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832197.350143:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218421760:0@lo:400:kworker.0 00000100:00100000:0.0:1788832197.350166:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832197.350210:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218421632 00000100:00100000:0.0:1788832197.350217:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218421632 00000100:00100000:2.0:1788832197.350485:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875726218420864:0@lo:400:kworker.0 00000100:00100000:2.0:1788832197.350519:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218421376:0@lo:400:kworker.0 00000100:00100000:2.0:1788832197.350531:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1875726218421888:0@lo:400:kworker.0 00000100:00100000:2.0:1788832197.350541:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218420992:0@lo:400:kworker.0 00000100:00100000:0.0:1788832197.352186:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218422144 00000100:00100000:0.0:1788832197.352201:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218422144 00010000:00080000:2.0:1788832197.352236:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc1b800 x1875726218421504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832197.352251:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218421504:0@lo:400:kworker.0 00000100:00100000:0.0:1788832197.352255:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218421760 00000100:00100000:0.0:1788832197.352257:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218421760 00000100:00100000:0.0:1788832197.352274:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00010000:00080000:2.0:1788832197.352277:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c36c89180 x1875726218422016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832197.352283:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218421632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832197.352286:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218422016:0@lo:400:kworker.0 00000100:00100000:2.0:1788832197.352330:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218420736 00000100:00100000:2.0:1788832197.352333:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218420736 00000100:00100000:2.0:1788832197.352358:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788832197.352359:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218421632:12345-0@lo:400:kworker.0 Request processed in 77us (8698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832197.352364:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218420736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832197.352366:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788832197.352381:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788832197.352387:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218422144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832197.352416:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218422144:12345-0@lo:400:kworker.0 Request processed in 29us (8701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832197.352422:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788832197.352432:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788832197.352438:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218421760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832197.352461:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218420736:12345-0@lo:400:kworker.0 Request processed in 96us (2821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832197.352461:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218421760:12345-0@lo:400:kworker.0 Request processed in 23us (2293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832197.352467:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788832197.352467:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788832197.352487:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218421248 00000100:00100000:0.0:1788832197.352491:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218421248 00000100:00080000:1.0:1788832197.352565:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788832197.352570:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788832197.352572:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788832197.352575:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788832197.352603:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218421120:12345-0@lo:400:kworker.0 Request processed in 8502us (9038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832197.352610:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788832197.355345:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788832197.355366:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218421248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832197.355460:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218421248:12345-0@lo:400:kworker.0 Request processed in 102us (5338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832197.355476:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788832197.355527:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218420736:0@lo:400:kworker.0 00000100:00100000:0.0:1788832197.355540:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218421248:0@lo:400:kworker.0 00000100:00100000:0.0:1788832197.355552:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218421760:0@lo:400:kworker.0 00000100:00100000:0.0:1788832197.355564:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218421120:0@lo:400:kworker.0 00000100:00100000:0.0:1788832197.355575:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218421632:0@lo:400:kworker.0 00000100:00100000:0.0:1788832197.355586:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218422144:0@lo:400:kworker.0 00000040:00080000:3.0:1788832197.418039:0:14211:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788832197.418048:0:14211:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788832197.418073:0:14211:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788832197.418140:0:14211:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788832197.526877:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832197.526888:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832197.526924:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788832197.526931:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788832197.527082:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c04dc5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875726218422272:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788832197.527186:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fb000 going to sleep for 11 seconds 00000040:00080000:2.0:1788832197.534518:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788832197.539136:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832197.539244:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c04dc5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875726218422272:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788832197.539844:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202613504 00000100:00100000:3.0:1788832197.539852:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202613504 00000100:00100000:3.0:1788832197.539909:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 78 00000100:00100000:3.0:1788832197.539919:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+59:11299:x1875726202613504:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788832197.539950:0:8742:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788832197.540060:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+59:11299:x1875726202613504:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 141us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832197.540068:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 78 00000004:00080000:0.0:1788832197.542205:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788832197.542245:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:0.0:1788832197.542289:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788832197.542301:0:6504:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d2c04fdb600 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788832197.542305:0:6504:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d2b07cfbf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d2c04fdb780 00000020:00080000:0.0:1788832197.542307:0:6504:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d2b07cfbc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d2c3fc0d200 00010000:00010000:0.0:1788832197.542350:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b283537305 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542386:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b283537305 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542392:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b283537305 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542398:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0ce00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832197.542402:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b283537305 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542410:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b283537305 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542426:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d2c0f9a5a00) 00010000:00010000:0.0:1788832197.542429:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832197.542434:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b283537305 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542440:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b283537305 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542457:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353730c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542462:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353730c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542467:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353730c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542472:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832197.542480:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353730c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542486:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353730c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542495:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:0.0:1788832197.542498:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832197.542500:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353730c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542506:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353730c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542552:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b28353734b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542560:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b28353734b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542565:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b28353734b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542569:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0d600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832197.542572:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b28353734b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542578:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b28353734b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542585:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2c0f9a5900) 00010000:00010000:0.0:1788832197.542588:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832197.542596:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b28353734b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542602:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b28353734b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542653:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537455 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542660:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537455 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542666:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537455 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542671:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2a00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832197.542674:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537455 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542679:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537455 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542689:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:0.0:1788832197.542691:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832197.542694:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537455 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542699:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537455 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542710:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537478 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542716:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537478 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542728:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537478 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542733:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832197.542736:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537478 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542743:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537478 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542752:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:0.0:1788832197.542755:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832197.542757:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537478 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542763:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537478 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542783:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835374be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542790:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835374be lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542797:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835374be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.542802:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030c00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832197.543190:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835374be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.543210:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835374be lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.543219:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:0.0:1788832197.543220:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832197.543223:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835374be lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.543229:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835374be lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788832197.543249:0:6557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:1.0:1788832197.543907:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788832197.543928:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218422400:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788832197.544000:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832197.544051:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218422400 00000100:00100000:1.0:1788832197.544058:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218422400 00000100:00100000:1.0:1788832197.544102:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788832197.544118:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fdaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3651:x1875726218422400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788832197.544145:0:10099:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1788832197.544174:0:10099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f69c2, atime: 0x6a9f69c3, ctime: 0x6a9f69c2, blocks: 0x8 00010000:00010000:1.0:1788832197.544182:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537566 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.544197:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=337s v=(0 0) 00010000:00010000:1.0:1788832197.544202:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832197.544208:0:10099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537566 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.544223:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537566 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.544232:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537566 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.544240:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537566 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.544257:0:10099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788832197.544403:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fdaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3651:x1875726218422400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 286us (402us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788832197.544411:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1788832197.544434:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832197.544440:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537566 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.544459:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfee00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:1.0:1788832197.544463:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537566 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.544472:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537566 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.544486:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537566 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.544493:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537566 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.544508:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832197.544510:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832197.544511:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788832197.544541:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d2c36c88700/2, rc 0, transno 4294967302 00000100:00100000:1.0:1788832197.544548:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218422400:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1788832197.544671:0:6557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788832197.545994:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832197.546061:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202613632 00000100:00100000:0.0:1788832197.546070:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202613632 00000100:00100000:0.0:1788832197.546122:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 79 00000100:00100000:0.0:1788832197.546132:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fda8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+12:11299:x1875726202613632:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788832197.546200:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353756d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.546215:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353756d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.546226:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353756d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551224:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537574 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551247:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537574 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551274:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537574 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551312:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353757b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551320:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353757b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551327:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353757b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832197.551803:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788832197.551809:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788832197.551825:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353757b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551838:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353756d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551844:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353756d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551850:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353756d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551855:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832197.551859:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353756d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551866:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353756d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551886:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d2b073ae800) 00010000:00010000:0.0:1788832197.551888:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832197.551893:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353756d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551898:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353756d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551909:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537574 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551915:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537574 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551921:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537574 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551925:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0cc00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832197.551927:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537574 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551932:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537574 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551939:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9d2c39195d00) 00010000:00010000:0.0:1788832197.551941:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832197.551944:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537574 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551949:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537574 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551974:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353757b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551980:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353757b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551986:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353757b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.551991:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0dc00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832197.551994:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353757b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.552000:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353757b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.552007:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:0.0:1788832197.552010:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832197.552012:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353757b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.552017:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353757b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832197.552159:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fda8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+12:11299:x1875726202613632:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 Request processed in 6024us (6167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832197.552170:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 79 00000100:00100000:0.0:1788832197.560257:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832197.560460:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202613888 00000100:00100000:1.0:1788832197.560469:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202613888 00000100:00100000:1.0:1788832197.560537:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 80 00000100:00100000:1.0:1788832197.560547:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+12:11299:x1875726202613888:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788832197.560568:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832197.560588:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537582 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04705 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.560818:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537589 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.560833:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537589 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.560844:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537589 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832197.560855:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788832197.560937:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537589 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.560944:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537589 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.560950:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537589 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.560955:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfee00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832197.560959:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537589 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.560966:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537589 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.560977:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:1.0:1788832197.560980:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788832197.560984:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537589 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.560998:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537589 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.561035:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537582 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04705 expref: 14 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.561045:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d2b073ae800) 00010000:00010000:1.0:1788832197.561048:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788832197.561056:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537582 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04705 expref: 14 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.561358:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cff400, rc 0) 00000100:00100000:1.0:1788832197.561494:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+13:11299:x1875726202613888:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 948us (1244us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1788832197.561503:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 80 00000100:00100000:1.0:1788832197.565062:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832197.565738:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202614016 00000100:00100000:3.0:1788832197.565750:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202614016 00000100:00100000:3.0:1788832197.565922:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 81 00000100:00100000:3.0:1788832197.565938:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fda9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+13:11299:x1875726202614016:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788832197.565973:0:13811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788832197.566084:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fda9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+13:11299:x1875726202614016:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 147us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832197.566091:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 81 00000100:00100000:2.0:1788832197.572927:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832197.573163:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202614272 00000100:00100000:1.0:1788832197.573173:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202614272 00000100:00100000:1.0:1788832197.573226:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 82 00000100:00100000:1.0:1788832197.573236:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+13:11299:x1875726202614272:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788832197.573255:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832197.573258:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788832197.573284:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b28353753c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046f7 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.573302:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:1.0:1788832197.573318:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788832197.573332:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537597 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0470c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788832197.574197:0:6526:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788832197.574352:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353759e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.574367:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353759e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.574378:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353759e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.574447:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537597 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0470c expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.574467:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353759e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0470c expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.574474:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d2b073ae200) 00010000:00010000:1.0:1788832197.574477:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832197.574480:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfee00, rc 0) 00000100:00100000:1.0:1788832197.576039:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+14:11299:x1875726202614272:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 2796us (3114us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788832197.576050:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 82 00000100:00100000:2.0:1788832197.586702:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832197.586744:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202614528 00000100:00100000:2.0:1788832197.586759:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202614528 00000100:00100000:2.0:1788832197.586827:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 83 00000100:00100000:2.0:1788832197.586836:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+14:11299:x1875726202614528:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788832197.586894:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832197.586921:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353759e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0470c expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.586937:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d2b073ae200) 00010000:00010000:2.0:1788832197.586947:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788832197.586974:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835375ac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.586988:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835375ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.586999:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835375ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.587058:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835375b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x1d000213 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.587067:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835375b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1d000213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.587074:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835375b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1d000213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.587116:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835375ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.587124:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835375ac lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.587136:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835375ac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.587142:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832197.587147:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835375ac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.587155:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835375ac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.587180:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:2.0:1788832197.587183:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832197.587187:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835375ac lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.587193:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835375ac lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.587205:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835375b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1d000213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.587212:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835375b3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1d000213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.587217:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835375b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1d000213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.587222:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030c00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832197.587225:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835375b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1d000213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.587240:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835375b3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1d000213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.587248:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x1d000213 (ffff9d2c36bee400) 00010000:00010000:2.0:1788832197.587250:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832197.587253:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835375b3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x1d000213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.587259:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835375b3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x1d000213 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832197.587338:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+13:11299:x1875726202614528:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 502us (648us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788832197.587346:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 83 00000100:00100000:2.0:1788832197.590260:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832197.594471:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202614656 00000100:00100000:1.0:1788832197.594554:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202614656 00000100:00100000:1.0:1788832197.594636:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 84 00000100:00100000:1.0:1788832197.594649:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+13:11299:x1875726202614656:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788832197.594678:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832197.594702:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835375ba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04713 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.594742:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835375c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.594757:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835375c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.594769:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835375c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.594889:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835375ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04713 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.594907:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835375c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04713 expref: 14 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.594916:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d2b073ae900) 00010000:00010000:1.0:1788832197.594919:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788832197.594922:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cffe00, rc 0) 00000100:00100000:1.0:1788832197.594990:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+14:11299:x1875726202614656:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 344us (4740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832197.594998:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 84 00000100:00100000:2.0:1788832197.604471:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832197.605450:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202614912 00000100:00100000:1.0:1788832197.605464:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202614912 00000100:00100000:1.0:1788832197.605692:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 85 00000100:00100000:1.0:1788832197.605704:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+14:11299:x1875726202614912:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788832197.605811:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835375c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.605827:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835375c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.605839:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835375c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788832197.606014:0:8742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1788832197.606024:0:8742:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 337646402529ns, next at 338646400506ns, rc = 0 00000004:00010000:1.0:1788832197.606075:0:8742:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df4d2dbd reply state 000000004b1d48b1 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835375c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.606088:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835375c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.606095:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d2b073ae900) 00010000:00010000:1.0:1788832197.606098:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788832197.606101:0:8742:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788832197.606213:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+16:11299:x1875726202614912:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 510us (1750us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788832197.606220:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 85 00000100:00100000:2.0:1788832197.608975:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832197.609067:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202615040 00000100:00100000:3.0:1788832197.609078:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202615040 00000100:00100000:3.0:1788832197.609169:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 86 00000100:00100000:3.0:1788832197.609179:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+16:11299:x1875726202615040:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832197.609205:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832197.609226:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b2835375cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0471a expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.609291:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b2835375cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0471a expref: 17 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.609307:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b2835375cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0471a expref: 17 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.609328:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d2b073ae900) 00010000:00010000:3.0:1788832197.609331:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788832197.609335:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dda00, rc 0) 00000100:00100000:3.0:1788832197.609584:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+17:11299:x1875726202615040:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 405us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832197.609592:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 86 00000100:00100000:0.0:1788832197.613329:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832197.613470:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202615168 00000100:00100000:1.0:1788832197.613480:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202615168 00000100:00100000:1.0:1788832197.613649:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:1.0:1788832197.613658:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875726202615168:12345-192.168.203.26@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788832197.613695:0:8442:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp t0 exp 0000000000000000 cur 337 last 0 00000020:00000080:1.0:1788832197.613729:0:8442:0:(genops.c:1385:class_connect()) connect: client 352fff76-09db-42cd-818a-16e788a01abb, cookie 0x998c12b2835375d6 00002000:00100000:1.0:1788832197.613756:0:8442:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 352fff76-09db-42cd-818a-16e788a01abb/ffff9d2c050ce800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788832197.613786:0:8442:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788832197.613873:0:8442:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788832197.613903:0:8442:0:(import.c:65:import_set_state_nolock()) ffff9d2c050c9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788832197.613984:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+6:2392:x1875726202615168:12345-192.168.203.26@tcp:8:lhsmtool_posix.0 Request processed in 325us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832197.613992:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:2.0:1788832197.616705:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832197.616908:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202615296 00000100:00100000:1.0:1788832197.616919:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202615296 00000100:00100000:1.0:1788832197.616987:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:1.0:1788832197.616997:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+6:0:x1875726202615296:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788832197.617307:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788832197.624729:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1788832197.624752:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 352fff76-09db-42cd-818a-16e788a01abb 00000100:00100000:1.0:1788832197.625256:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+5:0:x1875726202615296:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 8254us (8554us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788832197.625268:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:2.0:1788832197.628201:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832197.628287:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202615552 00000100:00100000:1.0:1788832197.628302:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202615552 00000100:00100000:1.0:1788832197.628359:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:1.0:1788832197.628369:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+17:11299:x1875726202615552:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788832197.628614:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+18:11299:x1875726202615552:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 246us (422us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1788832197.628932:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:0.0:1788832197.630988:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832197.631069:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202615808 00000100:00100000:1.0:1788832197.631078:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202615808 00000100:00100000:1.0:1788832197.631141:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 87 00000100:00100000:1.0:1788832197.631151:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+18:11299:x1875726202615808:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788832197.631294:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+18:11299:x1875726202615808:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 144us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832197.631302:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 87 00000100:00100000:2.0:1788832197.633826:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832197.633973:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202615936 00000100:00100000:1.0:1788832197.633986:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202615936 00000100:00100000:1.0:1788832197.634047:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 88 00000100:00100000:1.0:1788832197.634057:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+18:11299:x1875726202615936:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788832197.634075:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832197.634097:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b2835375dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04721 expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.634287:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835375e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.634302:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835375e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.634323:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835375e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832197.634365:0:8742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788832197.634457:0:8742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835375e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.634496:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b2835375dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04721 expref: 20 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.634516:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835375e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04721 expref: 19 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.634536:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d2b073ae900) 00010000:00010000:1.0:1788832197.634539:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788832197.634542:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfee00, rc 0) 00000100:00100000:1.0:1788832197.634756:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+19:11299:x1875726202615936:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 699us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832197.634764:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 88 00000100:00100000:2.0:1788832197.637942:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832197.638027:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202616064 00000100:00100000:1.0:1788832197.638038:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202616064 00000100:00100000:1.0:1788832197.638119:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:1.0:1788832197.638130:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+5:2394:x1875726202616064:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788832197.638145:0:10097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832197.638454:0:10097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f5c2618/0x998c12b2835375eb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04728 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788832197.638482:0:10097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f69c6, blocks: 0x0 00010000:00010000:1.0:1788832197.638576:0:10097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=337s v=(0 0) 00010000:00010000:1.0:1788832197.638580:0:10097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832197.638589:0:10097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f5c2618/0x998c12b2835375eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04728 expref: 6 pid: 10097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.638609:0:10097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f5c2618/0x998c12b2835375eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04728 expref: 6 pid: 10097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.638704:0:10097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cff200, rc 0) 00000100:00100000:1.0:1788832197.638859:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+6:2394:x1875726202616064:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 729us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832197.638866:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:3.0:1788832197.644216:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832197.644281:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202616320 00000100:00100000:3.0:1788832197.644292:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202616320 00000100:00100000:3.0:1788832197.644350:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 89 00000100:00100000:3.0:1788832197.644360:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+19:11299:x1875726202616320:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788832197.644706:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+19:11299:x1875726202616320:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 346us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832197.644715:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 89 00000100:00100000:0.0:1788832197.647680:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832197.647758:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202616448 00000100:00100000:1.0:1788832197.647768:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202616448 00000100:00100000:1.0:1788832197.647835:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:1.0:1788832197.647846:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+6:11299:x1875726202616448:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788832197.647865:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832197.647883:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000300111e3/0x998c12b2835375f2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0472f expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.647915:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f5c2618/0x998c12b2835375eb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04728 expref: 7 pid: 10097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.647924:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832197.647929:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832197.647935:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000300111e3/0x998c12b2835375f2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0472f expref: 7 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.647969:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f5c2618/0x998c12b2835375eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04728 expref: 7 pid: 10097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.647984:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f5c2618/0x998c12b2835375eb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04728 expref: 7 pid: 10097 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832197.647998:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fda9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8442:1875726218422528:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788832197.648102:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c358c23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832197.650589:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832197.650731:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fda9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8442:1875726218422528:192.168.203.26@tcp:104: 00010000:00010000:1.0:1788832197.650764:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000300111e3/0x998c12b2835375f2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0472f expref: 7 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.650795:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cffa00, rc 0) 00000100:00100000:1.0:1788832197.650845:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+7:11299:x1875726202616448:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 3000us (3173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832197.650854:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:3.0:1788832197.651715:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202616576 00000100:00100000:3.0:1788832197.651725:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202616576 00010000:00010000:3.0:1788832197.651761:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f5c2618/0x998c12b2835375eb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04728 expref: 7 pid: 10097 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832197.651813:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:3.0:1788832197.651823:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+7:2394:x1875726202616576:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832197.651836:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832197.651859:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f5c2618/0x998c12b2835375eb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04728 expref: 7 pid: 10097 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.652124:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f5c2618/0x998c12b2835375eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04728 expref: 7 pid: 10097 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.652152:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f5c2618/0x998c12b2835375eb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04728 expref: 7 pid: 10097 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.652168:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832197.652173:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832197.652194:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000300111e3/0x998c12b2835375f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0472f expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.652205:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000300111e3/0x998c12b2835375f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0472f expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.652247:0:6511:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000300111e3/0x998c12b2835375f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0472f expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832197.652261:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c89180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6511:1875726218422656:192.168.203.26@tcp:105: 00000100:00100000:3.0:1788832197.652380:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788832197.657435:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832197.657534:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202616704 00000100:00100000:1.0:1788832197.657544:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202616704 00002000:00100000:1.0:1788832197.657594:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9d2c04dc7100 x1875726202616704/t0(0) o4->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:138/0 lens 504/0 e 0 to 0 dl 1788832208 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788832197.657606:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2c04dc7100 with x1875726202616704 ext(0->8) 00002000:00010000:1.0:1788832197.657611:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d2c04dc7100 00000100:00100000:1.0:1788832197.657714:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:1.0:1788832197.657724:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:352fff76-09db-42cd-818a-16e788a01abb+7:2394:x1875726202616704:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788832197.659091:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c89180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6511:1875726218422656:192.168.203.26@tcp:105: 00010000:00010000:3.0:1788832197.659122:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832197.659208:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+9:2394:x1875726202616576:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 7386us (8626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832197.659219:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:1.0:1788832197.659258:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:352fff76-09db-42cd-818a-16e788a01abb+8:2394:x1875726202616704:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 Request processed in 1534us (1834us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788832197.659269:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 0 00002000:00100000:1.0:1788832197.659280:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9d2c04dc7100 x1875726202616704/t4294967303(0) o4->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:138/0 lens 504/448 e 0 to 0 dl 1788832208 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788832197.659290:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2c04dc7100 with x1875726202616704 ext(0->8) 00002000:00010000:1.0:1788832197.659351:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d2c04dc7100 00000100:00100000:0.0:1788832197.663031:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832197.663103:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202616832 00000100:00100000:3.0:1788832197.663114:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202616832 00000100:00100000:3.0:1788832197.663175:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 90 00000100:00100000:3.0:1788832197.663185:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+19:11299:x1875726202616832:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788832197.666027:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1788832197.666048:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788832197.666075:0:6504:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:0.0:1788832197.666231:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+15:11299:x1875726202616832:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 Request processed in 3042us (3206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832197.666241:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 90 00000100:00100000:2.0:1788832197.666784:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788832197.666804:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218422784:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788832197.666863:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788832197.667258:0:6557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1788832197.667270:0:6557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:1.0:1788832197.667373:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835375c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.667386:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835375c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.667393:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835375c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.667399:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832197.667404:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835375c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.667412:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835375c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.667430:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d2b073ae900) 00010000:00010000:1.0:1788832197.667433:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788832197.667439:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835375c8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.667445:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835375c8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832197.667487:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218422784 00000100:00100000:1.0:1788832197.667495:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218422784 00000100:00100000:1.0:1788832197.667546:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788832197.667555:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218422784:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788832197.667799:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788832197.667804:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788832198 00002000:00010000:0.0:1788832197.667806:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788832197.667808:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788832198 -> 1788832198 00002000:00010000:0.0:1788832197.667810:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788832197.667910:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3654:x1875726218422784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 356us (1046us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788832197.667918:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1788832197.668057:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d2c3fc19c00/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788832197.668065:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218422784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788832197.669133:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832197.669206:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202616960 00000100:00100000:1.0:1788832197.669214:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202616960 00000100:00100000:1.0:1788832197.669264:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:1.0:1788832197.669273:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+8:2393:x1875726202616960:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788832197.671172:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1788832197.671185:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1788832197.671336:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202616960:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 Request processed in 2059us (2204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832197.671346:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:0.0:1788832197.674451:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832197.674891:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202617216 00000100:00100000:1.0:1788832197.674901:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202617216 00000100:00100000:0.0:1788832197.675079:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 91 00000100:00100000:0.0:1788832197.675090:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+14:11299:x1875726202617216:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788832197.675145:0:8742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832197.675179:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835375e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04721 expref: 14 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.675197:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d2b073ae900) 00010000:00010000:0.0:1788832197.675202:0:8742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788832197.675233:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b2835375f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.675245:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b2835375f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.675255:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b2835375f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788832197.675388:0:8742:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bcda955b reply state 000000007f533b46 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b2835375f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.675401:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b2835375f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.675408:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d2b073ae900) 00010000:00010000:0.0:1788832197.675410:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788832197.675413:0:8742:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788832197.675553:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+15:11299:x1875726202617216:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 464us (1110us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1788832197.675561:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 91 00000100:00100000:1.0:1788832197.680333:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832197.680467:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202617344 00000100:00100000:3.0:1788832197.680477:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202617344 00000100:00100000:3.0:1788832197.680534:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:3.0:1788832197.680545:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fda9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202617344:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788832197.680731:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788832197.680734:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788832198 -> 1788832196 00002000:00010000:3.0:1788832197.680737:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788832195 00002000:00010000:3.0:1788832197.680739:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788832198 -> 1788832196 00002000:00010000:3.0:1788832197.680741:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788832197.681067:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fda9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+7:2393:x1875726202617344:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 522us (742us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788832197.681074:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:1.0:1788832197.684073:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832197.684232:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202617600 00000100:00100000:2.0:1788832197.684241:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202617600 00000100:00100000:2.0:1788832197.684336:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 92 00000100:00100000:2.0:1788832197.684347:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fdaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+15:11299:x1875726202617600:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788832197.684438:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537600 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.684455:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835375c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04713 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.684465:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537600 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.684500:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835375c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04713 expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.684514:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835375c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04713 expref: 15 pid: 6525 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832197.684527:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1875726218422912:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788832197.684667:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788832197.687780:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832197.687975:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202617728 00000100:00100000:0.0:1788832197.687984:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202617728 00010000:00010000:0.0:1788832197.688023:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835375c1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04713 expref: 16 pid: 6525 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832197.688086:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:0.0:1788832197.688096:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fdaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+16:2393:x1875726202617728:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832197.688110:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832197.688117:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835375c1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04713 expref: 16 pid: 6525 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.688130:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835375c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04713 expref: 16 pid: 6525 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.688153:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d2b073ae900) 00010000:00010000:0.0:1788832197.688158:0:10343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537600 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.688178:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537600 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.688185:0:10343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537600 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.688205:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832197.688257:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fdaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+16:2393:x1875726202617728:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 162us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832197.688264:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 60 00010000:00010000:2.0:1788832197.688658:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835375c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04713 expref: 15 pid: 6525 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832197.688676:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1875726218422912:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832197.688696:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537600 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.688719:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537600 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.688725:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537600 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.688765:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537600 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.688782:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537600 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.688789:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537600 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.688867:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031e00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832197.688872:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537600 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.688879:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537600 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.688889:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d2b073ae900) 00010000:00010000:2.0:1788832197.688892:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788832197.688897:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537600 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.688903:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537600 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832197.688993:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fdaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+14:11299:x1875726202617600:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 Request processed in 4647us (4929us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788832197.689007:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 92 00000100:00100000:1.0:1788832197.691047:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832197.691133:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202617856 00000100:00100000:0.0:1788832197.691141:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202617856 00000100:00100000:0.0:1788832197.691193:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:0.0:1788832197.691203:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fda8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+7:2393:x1875726202617856:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788832197.691260:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537607 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.691287:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000300111e3/0x998c12b2835375f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0472f expref: 7 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.691296:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832197.691300:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788832197.691304:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537607 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.691336:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000300111e3/0x998c12b2835375f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0472f expref: 7 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.691350:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000300111e3/0x998c12b2835375f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0472f expref: 7 pid: 8442 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832197.691368:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fde1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8441:1875726218423040:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788832197.692037:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832197.694866:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fde1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8441:1875726218423040:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788832197.694896:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537607 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832197.695826:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832197.695884:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202617984 00000100:00100000:2.0:1788832197.695894:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202617984 00010000:00010000:2.0:1788832197.695951:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000300111e3/0x998c12b2835375f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0472f expref: 8 pid: 8442 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832197.695990:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:2.0:1788832197.696001:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fda9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+8:2394:x1875726202617984:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832197.696019:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832197.696044:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000300111e3/0x998c12b2835375f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0472f expref: 8 pid: 8442 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.696057:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000300111e3/0x998c12b2835375f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0472f expref: 8 pid: 8442 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.696079:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000300111e3/0x998c12b2835375f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0472f expref: 8 pid: 8442 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.696097:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832197.696101:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832197.696107:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537607 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.696117:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537607 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.696171:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832197.696228:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fda9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+7:2394:x1875726202617984:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 228us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832197.696236:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 61 00010000:00010000:0.0:1788832197.696243:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537607 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.696265:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537607 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.696286:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537607 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.696294:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537607 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.696301:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537607 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.696308:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0d600 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:0.0:1788832197.696313:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537607 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.696321:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537607 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.696335:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537607 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.696343:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537607 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832197.696565:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fda8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202617856:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 Request processed in 5363us (5529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832197.696573:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:1.0:1788832197.699017:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832197.699086:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202618240 00000100:00100000:0.0:1788832197.699094:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202618240 00000100:00100000:0.0:1788832197.699139:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 93 00000100:00100000:0.0:1788832197.699149:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b074f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+14:11299:x1875726202618240:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788832197.699313:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353760e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.699332:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353744e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046b8 expref: 14 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.699342:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353760e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.699379:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353744e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046b8 expref: 14 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.699393:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353744e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046b8 expref: 14 pid: 6527 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832197.699477:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fde1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1875726218423168:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788832197.699573:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832197.705933:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832197.706001:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202618368 00000100:00100000:2.0:1788832197.706011:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202618368 00010000:00010000:2.0:1788832197.706048:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353744e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046b8 expref: 15 pid: 6527 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832197.706092:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 62 00000100:00100000:2.0:1788832197.706103:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18e27850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+15:2394:x1875726202618368:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832197.706116:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832197.706123:0:7466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353744e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046b8 expref: 15 pid: 6527 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.706136:0:7466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353744e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046b8 expref: 15 pid: 6527 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.706160:0:7466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:2.0:1788832197.706166:0:7466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353760e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.706176:0:7466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353760e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.706184:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353760e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.706215:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832197.706273:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18e27850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+15:2394:x1875726202618368:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 172us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832197.706281:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 62 00010000:00010000:3.0:1788832197.706853:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353744e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046b8 expref: 14 pid: 6527 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832197.706871:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fde1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1875726218423168:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788832197.706893:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353760e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.706902:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353760e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.706908:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353760e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.707084:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537615 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.707096:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b2835375cf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0471a expref: 14 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.707104:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537615 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.707142:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b2835375cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0471a expref: 14 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.707156:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b2835375cf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0471a expref: 14 pid: 13811 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832197.707183:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c89180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1875726218423296:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788832197.707253:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832197.710282:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832197.710393:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202618496 00000100:00100000:2.0:1788832197.710403:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202618496 00010000:00010000:2.0:1788832197.710455:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b2835375cf lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0471a expref: 15 pid: 13811 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832197.710515:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:2.0:1788832197.710525:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+15:2393:x1875726202618496:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832197.710541:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832197.710548:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b2835375cf lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0471a expref: 15 pid: 13811 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.710562:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b2835375cf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0471a expref: 15 pid: 13811 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.710586:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d2b073ae900) 00010000:00010000:2.0:1788832197.710592:0:10343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537615 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.710603:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537615 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.710611:0:10343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537615 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832197.710684:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832197.710738:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+15:2393:x1875726202618496:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 214us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832197.710745:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 63 00010000:00010000:3.0:1788832197.711230:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b2835375cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0471a expref: 14 pid: 13811 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832197.711247:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c89180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1875726218423296:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788832197.711268:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537615 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.711277:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537615 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.711284:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537615 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788832197.711384:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1788832197.711504:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1788832197.711538:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1788832197.711818:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c89180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6527:1875726218423424:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788832197.711878:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832197.711911:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788832197.712011:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218423424 00000100:00100000:2.0:1788832197.712018:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218423424 00000100:00100000:2.0:1788832197.712056:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788832197.712065:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6527:x1875726218423424:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788832197.712158:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6527:x1875726218423424:12345-0@lo:1000:mdt00_002.0 Request processed in 93us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832197.712175:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788832197.713297:0:6527:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788832197.713305:0:6527:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d2c3fc19c00, transno 4294967304 00000100:00100000:3.0:1788832197.713327:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c89180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6527:1875726218423424:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788832197.713971:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1788832197.714033:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c182ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6527:1875726218423552:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788832197.714091:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832197.714130:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832197.714229:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218423552 00000100:00100000:2.0:1788832197.714236:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218423552 00000100:00100000:2.0:1788832197.714281:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788832197.714290:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6527:x1875726218423552:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788832197.714578:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6527:x1875726218423552:12345-0@lo:1000:mdt00_002.0 Request processed in 288us (485us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788832197.714586:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788832197.714820:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c182ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6527:1875726218423552:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788832197.714865:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537615 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.714874:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537615 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.714882:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537615 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.714887:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832197.714892:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537615 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.714899:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537615 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.714914:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d2b073ae900) 00010000:00010000:3.0:1788832197.714918:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788832197.714923:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537615 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.714929:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537615 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.714972:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537543 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.714978:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537543 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.714983:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537543 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.714988:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832197.714991:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537543 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.714996:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537543 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.715005:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:3.0:1788832197.715007:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788832197.715009:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537543 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.715014:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537543 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.715058:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b28353761c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.715071:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b28353755f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046fe expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.715080:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b28353761c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.715114:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b28353755f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046fe expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.715128:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b28353755f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046fe expref: 17 pid: 6526 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832197.715139:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36c89180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1875726218423680:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788832197.715377:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788832197.718540:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36c89180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1875726218423680:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788832197.718572:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b28353761c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832197.720152:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832197.720236:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202618624 00000100:00100000:3.0:1788832197.720246:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202618624 00010000:00010000:3.0:1788832197.720284:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b28353755f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046fe expref: 18 pid: 6526 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832197.720326:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:3.0:1788832197.720336:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+18:2394:x1875726202618624:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832197.720349:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832197.720357:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b28353755f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046fe expref: 18 pid: 6526 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.720370:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b28353755f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046fe expref: 18 pid: 6526 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.720419:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b28353755f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc046fe expref: 18 pid: 6526 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.720435:0:10344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:3.0:1788832197.720440:0:10344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b28353761c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.720449:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b28353761c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.720457:0:10344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b28353761c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.720488:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832197.720546:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+17:2394:x1875726202618624:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 211us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832197.720554:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 64 00010000:00010000:0.0:1788832197.721238:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b28353761c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.721248:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b28353761c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.721260:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b28353761c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.721266:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b28353761c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.721273:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b28353761c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.721279:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092ddc00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832197.721283:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b28353761c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.721290:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b28353761c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.721302:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:0.0:1788832197.721306:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832197.721309:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b28353761c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.721316:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b28353761c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.721327:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353760e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.721347:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353760e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.721353:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353760e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.721357:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832197.721360:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353760e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.721365:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353760e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.721386:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c0ad05100) 00010000:00010000:0.0:1788832197.721388:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788832197.721391:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353760e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832197.721397:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b28353760e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832197.721556:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b074f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+16:11299:x1875726202618240:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 22407us (22545us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788832197.721565:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 93 00000020:00080000:0.0:1788832197.721569:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788832197.721821:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788832197.721826:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788832197.721840:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788832197.721847:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788832197.729717:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832197.729874:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202618880 00000100:00100000:3.0:1788832197.729885:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202618880 00000100:00100000:3.0:1788832197.729940:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:3.0:1788832197.729951:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+16:11299:x1875726202618880:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788832197.730228:0:6528:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788832197.730259:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1788832197.730310:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537623 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.730325:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537623 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.730336:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537623 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.730343:0:6528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537623 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.730349:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537623 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.730354:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537623 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832197.730380:0:6528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788832197.730472:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+18:11299:x1875726202618880:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 522us (762us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788832197.730480:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000020:00080000:3.0:1788832197.730485:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788832197.731041:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832197.731049:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537623 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.731057:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc200 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:1.0:1788832197.731061:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537623 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.731080:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537623 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.731095:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d2b073ae900) 00010000:00010000:1.0:1788832197.731098:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788832197.731102:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537623 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.731109:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537623 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832197.731135:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832197.731137:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832197.731139:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832197.848067:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788832197.848093:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218423808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788832197.848165:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832197.848295:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218423808 00000100:00100000:0.0:1788832197.848304:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218423808 00000100:00100000:0.0:1788832197.848368:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788832197.848379:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218423808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788832197.848411:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788832197.848459:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218423808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832197.848466:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788832197.848760:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218423808:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788832198.102805:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832198.358972:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218423936:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832198.359053:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832198.359257:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218423936 00000100:00100000:0.0:1788832198.359266:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218423936 00000100:00100000:0.0:1788832198.359323:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788832198.359333:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218423936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788832198.359357:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1788832198.359814:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218423936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 479us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832198.359822:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788832198.359892:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218423936:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832198.872289:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832198.872322:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218424064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832198.872412:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832198.873278:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218424064 00000100:00100000:3.0:1788832198.873291:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218424064 00000100:00100000:3.0:1788832198.873358:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788832198.873499:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875726218424064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788832198.873531:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1788832198.873637:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875726218424064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832198.873646:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788832198.873734:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218424064:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788832199.128489:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788832199.265458:0:14262:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832199.265468:0:14262:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832199.265491:0:14262:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788832199.265497:0:14262:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788832199.383352:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832199.383397:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832199.383432:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832199.383452:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832199.383469:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832199.383486:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832199.383506:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832199.383531:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202619520 00000100:00100000:1.0:1788832199.383540:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202619520 00000100:00100000:1.0:1788832199.383593:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202619392 00000100:00100000:1.0:1788832199.383596:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202619392 00000100:00100000:1.0:1788832199.383648:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 104 00000100:00100000:1.0:1788832199.383666:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+7:2393:x1875726202619520:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832199.383738:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+7:2393:x1875726202619520:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 81us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832199.383746:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 104 00000100:00100000:3.0:1788832199.383948:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202619008 00000100:00100000:3.0:1788832199.383953:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202619008 00000100:00100000:3.0:1788832199.383987:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 377 00000100:00100000:3.0:1788832199.383995:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c404aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2393:x1875726202619008:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832199.384025:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c404aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2393:x1875726202619008:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 32us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832199.384031:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 377 00000100:00100000:3.0:1788832199.384060:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202619264 00000100:00100000:3.0:1788832199.384064:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202619264 00000100:00100000:3.0:1788832199.384092:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202619776 00000100:00100000:3.0:1788832199.384095:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202619776 00000100:00100000:3.0:1788832199.384111:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202619136 00000100:00100000:3.0:1788832199.384114:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202619136 00000100:00100000:3.0:1788832199.384128:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202619648 00000100:00100000:3.0:1788832199.384130:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202619648 00000100:00100000:3.0:1788832199.384146:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 269 00000100:00100000:3.0:1788832199.384152:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202619264:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832199.384180:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202619264:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832199.384186:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 269 00000100:00100000:3.0:1788832199.384200:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 270 00000100:00100000:3.0:1788832199.384206:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202619776:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832199.384230:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202619776:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832199.384253:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 270 00000100:00100000:3.0:1788832199.384268:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 271 00000100:00100000:3.0:1788832199.384274:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+18:2393:x1875726202619136:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832199.384306:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+18:2393:x1875726202619136:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 32us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832199.384312:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 271 00000100:00100000:3.0:1788832199.384324:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 272 00000100:00100000:3.0:1788832199.384330:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202619648:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832199.384353:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202619648:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 23us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832199.384358:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 272 00000100:00100000:3.0:1788832199.384381:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 105 00000100:00100000:3.0:1788832199.384388:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202619392:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832199.384427:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202619392:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 40us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832199.384433:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 105 00000100:00080000:1.0:1788832199.384502:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788832199.384506:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788832199.384509:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788832199.384511:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788832199.397330:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832199.397841:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202620032 00000100:00100000:3.0:1788832199.397851:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202620032 00000100:00100000:3.0:1788832199.397915:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 94 00000100:00100000:3.0:1788832199.397925:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+18:11316:x1875726202620032:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788832199.397948:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832199.397970:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b28353762a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04736 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.398100:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd200/0x998c12b283537631 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.398115:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd200/0x998c12b283537631 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.398126:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd200/0x998c12b283537631 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832199.398136:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788832199.398239:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b28353762a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04736 expref: 21 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.398256:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd200/0x998c12b283537631 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04736 expref: 20 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.398264:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:3.0:1788832199.398267:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788832199.398271:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dd200, rc 0) 00000100:00100000:3.0:1788832199.403283:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+20:11316:x1875726202620032:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 5345us (5949us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788832199.403297:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 94 00000100:00100000:3.0:1788832199.409656:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832199.409800:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202620160 00000100:00100000:0.0:1788832199.409810:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202620160 00000100:00100000:0.0:1788832199.409889:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 95 00000100:00100000:0.0:1788832199.409900:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+20:11316:x1875726202620160:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:0.0:1788832199.409981:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353763f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.409999:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353763f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410013:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353763f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410046:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537646 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410055:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537646 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410062:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537646 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410140:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b28353764d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410150:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b28353764d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410156:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b28353764d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788832199.410216:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b28353764d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410229:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353763f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410236:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353763f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410243:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353763f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410249:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0dc00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832199.410254:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353763f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410269:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353763f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410285:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:0.0:1788832199.410288:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832199.410293:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353763f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410299:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353763f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410311:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537646 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410317:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537646 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410323:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537646 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410328:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0ca00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832199.410331:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537646 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410337:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537646 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410344:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2c39194d00) 00010000:00010000:0.0:1788832199.410347:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832199.410350:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537646 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410380:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537646 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410396:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b28353764d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410403:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b28353764d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410409:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b28353764d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410414:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832199.410417:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b28353764d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410423:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b28353764d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410432:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c39194300) 00010000:00010000:0.0:1788832199.410434:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832199.410437:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b28353764d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.410443:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b28353764d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832199.410521:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+20:11316:x1875726202620160:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 622us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832199.410531:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 95 00000100:00100000:1.0:1788832199.510033:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832199.510289:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202620416 00000100:00100000:0.0:1788832199.510300:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202620416 00000100:00100000:0.0:1788832199.510371:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 96 00000100:00100000:0.0:1788832199.510381:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+20:11320:x1875726202620416:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788832199.510405:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832199.510426:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537654 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0473d expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.510509:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b28353765b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.510525:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b28353765b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.510537:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b28353765b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.510553:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537662 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.510561:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537662 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.510568:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537662 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.510720:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537669 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.510729:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537669 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.510748:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537669 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832199.510757:0:8742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788832199.510848:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b28353765b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.510856:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b28353765b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.510863:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b28353765b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.510869:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0ca00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832199.510874:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b28353765b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.511237:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b28353765b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.511253:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:0.0:1788832199.511255:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832199.511260:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b28353765b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.511265:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b28353765b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.511278:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537662 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.511284:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537662 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.511298:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537662 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.511304:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0dc00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832199.511307:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537662 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.511313:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537662 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.511321:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2c39194300) 00010000:00010000:0.0:1788832199.511324:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832199.511326:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537662 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.511331:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537662 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.511375:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537654 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0473d expref: 23 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.511388:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537669 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0473d expref: 22 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.511395:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c39194d00) 00010000:00010000:0.0:1788832199.511397:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788832199.511400:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0d800, rc 0) 00000100:00100000:0.0:1788832199.511550:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+22:11320:x1875726202620416:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1169us (1525us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788832199.511568:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 96 00000100:00100000:0.0:1788832199.525603:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832199.526370:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202620544 00000100:00100000:3.0:1788832199.526382:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202620544 00000100:00100000:3.0:1788832199.526451:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 97 00000100:00100000:3.0:1788832199.526460:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+22:11320:x1875726202620544:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:3.0:1788832199.526549:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b283537677 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.526566:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b283537677 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.526579:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b283537677 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.526615:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b283537677 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.526655:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b283537677 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.526661:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b283537677 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.526667:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dda00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832199.526671:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b283537677 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.526679:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b283537677 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.526691:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c39194d00) 00010000:00010000:3.0:1788832199.526694:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788832199.526698:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b283537677 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.526704:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b283537677 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832199.526844:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+22:11320:x1875726202620544:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 383us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832199.526851:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 97 00000100:00100000:2.0:1788832199.530965:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832199.531054:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202620800 00000100:00100000:3.0:1788832199.531064:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202620800 00000100:00100000:3.0:1788832199.531135:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:3.0:1788832199.531145:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18f2bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+22:11320:x1875726202620800:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788832199.531372:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18f2bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+23:11320:x1875726202620800:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 227us (415us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1788832199.531380:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:1.0:1788832199.566940:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832199.567082:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202621056 00000100:00100000:3.0:1788832199.567091:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202621056 00000100:00100000:3.0:1788832199.567839:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 98 00000100:00100000:3.0:1788832199.567854:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+23:10839:x1875726202621056:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788832199.567880:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832199.567901:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b28353767e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04744 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.568031:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537685 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.568046:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537669 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0473d expref: 24 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.568055:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537685 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.568118:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537669 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0473d expref: 24 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.568134:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537669 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0473d expref: 24 pid: 8742 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832199.568147:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1875726218424192:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788832199.568240:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832199.571159:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1875726218424192:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788832199.571194:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537685 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832199.571799:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832199.571878:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202621184 00000100:00100000:2.0:1788832199.571886:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202621184 00010000:00010000:2.0:1788832199.571928:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537669 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0473d expref: 25 pid: 8742 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832199.571967:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:2.0:1788832199.572050:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+25:2394:x1875726202621184:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832199.572135:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832199.572145:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537669 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0473d expref: 25 pid: 8742 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832199.572159:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537669 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0473d expref: 25 pid: 8742 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832199.572183:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537669 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0473d expref: 25 pid: 8742 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832199.572201:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c39194d00) 00010000:00010000:2.0:1788832199.572206:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537685 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832199.572215:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537685 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832199.572222:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537685 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832199.572351:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832199.572468:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+24:2394:x1875726202621184:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 483us (661us total) trans 0 rc 0/0 00010000:00010000:3.0:1788832199.572469:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537685 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832199.572483:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 65 00010000:00010000:3.0:1788832199.572769:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537685 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832199.572799:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788832199.572992:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b28353767e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04744 expref: 25 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.573018:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537685 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04744 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.573028:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c39194d00) 00010000:00010000:3.0:1788832199.573032:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788832199.573065:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dc400, rc 0) 00000100:00100000:3.0:1788832199.573126:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+24:10839:x1875726202621056:12345-192.168.203.26@tcp:101:bash.0 Request processed in 5275us (6196us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1788832199.573136:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 98 00000100:00100000:1.0:1788832199.578342:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832199.578455:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202621312 00000100:00100000:0.0:1788832199.578468:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202621312 00000100:00100000:0.0:1788832199.578738:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 99 00000100:00100000:0.0:1788832199.578752:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+24:10839:x1875726202621312:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1788832199.578792:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832199.578814:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537693 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0474b expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.578997:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353769a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.579013:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353769a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.579026:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353769a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.579156:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537693 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0474b expref: 26 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.579177:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353769a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0474b expref: 25 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.579186:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c39194d00) 00010000:00010000:0.0:1788832199.579188:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788832199.579192:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0dc00, rc 0) 00000100:00100000:0.0:1788832199.579279:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+25:10839:x1875726202621312:12345-192.168.203.26@tcp:101:bash.0 Request processed in 530us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832199.579287:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 99 00000100:00100000:2.0:1788832199.585574:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832199.585868:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202621568 00000100:00100000:0.0:1788832199.585883:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202621568 00000100:00100000:0.0:1788832199.585964:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 100 00000100:00100000:0.0:1788832199.585976:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+25:10839:x1875726202621568:12345-192.168.203.26@tcp:36:bash.0 00010000:00010000:0.0:1788832199.586298:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b2835376a1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.586319:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b2835376a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.586345:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b2835376a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788832199.586403:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1788832199.586427:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013694666 reply state 0000000022f96535 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b2835376a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.586442:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b2835376a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.586451:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c39194d00) 00010000:00010000:0.0:1788832199.586454:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788832199.586458:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788832199.586661:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1788832199.586794:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+29:10839:x1875726202621568:12345-192.168.203.26@tcp:36:bash.0 Request processed in 818us (1232us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788832199.586802:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 100 00000020:00080000:0.0:1788832199.586815:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788832199.590855:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832199.590960:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202621696 00000100:00100000:2.0:1788832199.590974:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202621696 00000100:00100000:2.0:1788832199.591090:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 101 00000100:00100000:2.0:1788832199.591102:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+29:10839:x1875726202621696:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:2.0:1788832199.591131:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832199.591156:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b2835376a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04752 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832199.591230:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b2835376a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04752 expref: 30 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832199.591248:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b2835376a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04752 expref: 30 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832199.591271:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c39194d00) 00010000:00010000:2.0:1788832199.591274:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788832199.591279:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031600, rc 0) 00000100:00100000:2.0:1788832199.591427:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+30:10839:x1875726202621696:12345-192.168.203.26@tcp:101:bash.0 Request processed in 259us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832199.591436:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 101 00000100:00100000:1.0:1788832199.594958:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832199.595070:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202621824 00000100:00100000:0.0:1788832199.595084:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202621824 00000100:00100000:0.0:1788832199.595160:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:0.0:1788832199.595173:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+6:10839:x1875726202621824:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1788832199.595198:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832199.595227:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000daef9094/0x998c12b2835376af lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04759 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788832199.595258:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f69c4, atime: 0x6a9f69c3, ctime: 0x6a9f69c4, blocks: 0x8 00010000:00010000:0.0:1788832199.595286:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788832199.595291:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832199.595299:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daef9094/0x998c12b2835376af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04759 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.595319:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000daef9094/0x998c12b2835376af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04759 expref: 7 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.595335:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0c200, rc 0) 00000100:00100000:0.0:1788832199.595421:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+7:10839:x1875726202621824:12345-192.168.203.26@tcp:101:bash.0 Request processed in 250us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832199.595429:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:0.0:1788832199.599896:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832199.600177:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202621952 00000100:00100000:3.0:1788832199.600192:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202621952 00002000:00010000:3.0:1788832199.600247:0:8445:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1788832199.600253:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2c3fde2300 with x1875726202621952 ext(0->18446744073709551615) 00002000:00010000:3.0:1788832199.600268:0:8445:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d2c3fde2300. 00000100:00100000:3.0:1788832199.600308:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:3.0:1788832199.600319:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:352fff76-09db-42cd-818a-16e788a01abb+7:2393:x1875726202621952:12345-192.168.203.26@tcp:10:bash.0 00002000:00010000:3.0:1788832199.600950:0:8445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788832199.600957:0:8445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788832196 -> 1788832200 00002000:00010000:3.0:1788832199.600960:0:8445:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788832195 -> 1788832195 00002000:00010000:3.0:1788832199.600963:0:8445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788832196 -> 1788832200 00002000:00010000:3.0:1788832199.600966:0:8445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788832199.603321:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:352fff76-09db-42cd-818a-16e788a01abb+8:2393:x1875726202621952:12345-192.168.203.26@tcp:10:bash.0 Request processed in 2987us (3423us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788832199.603375:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1 00002000:00010000:2.0:1788832199.603383:0:8445:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1788832199.603387:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2c3fde2300 with x1875726202621952 ext(0->18446744073709551615) 00002000:00010000:2.0:1788832199.603402:0:8445:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d2c3fde2300. 00000100:00100000:1.0:1788832199.724065:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832199.724408:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202622080 00000100:00100000:0.0:1788832199.724422:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202622080 00000100:00100000:0.0:1788832199.724504:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 102 00000100:00100000:0.0:1788832199.724517:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+30:11334:x1875726202622080:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:0.0:1788832199.724671:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835376b6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.724705:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835376b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.724720:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835376b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.724741:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835376bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.724749:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835376bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.724764:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835376bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.724858:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b2835376c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.724868:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b2835376c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.724875:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b2835376c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788832199.724933:0:8742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b2835376c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.724948:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835376b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.724966:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835376b6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.724974:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835376b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.724981:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832199.724986:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835376b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.724995:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835376b6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.725010:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:0.0:1788832199.725013:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832199.725018:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835376b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.725024:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835376b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.725039:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835376bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.725045:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835376bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.725052:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835376bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.725058:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0d800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832199.725068:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835376bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.725075:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835376bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.725505:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2c39194500) 00010000:00010000:0.0:1788832199.725510:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832199.725515:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835376bd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.725522:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835376bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.725542:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b2835376c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.725548:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b2835376c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.725554:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b2835376c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.725560:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0d000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832199.725563:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b2835376c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.725570:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b2835376c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.725579:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c39194d00) 00010000:00010000:0.0:1788832199.725581:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832199.725594:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b2835376c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832199.725601:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b2835376c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832199.726865:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+30:11334:x1875726202622080:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 2338us (2802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832199.726879:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 102 00000100:00100000:1.0:1788832199.798793:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832199.799019:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202622336 00000100:00100000:3.0:1788832199.799034:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202622336 00000100:00100000:3.0:1788832199.799120:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 103 00000100:00100000:3.0:1788832199.799134:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+30:11337:x1875726202622336:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788832199.799163:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832199.799192:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b2835376cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04760 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.799296:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b2835376d2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.799352:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b2835376d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.799430:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b2835376d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.799451:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b2835376d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.799458:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b2835376d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.799466:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b2835376d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.799672:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b2835376e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.799683:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b2835376e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.799691:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b2835376e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832199.799887:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788832199.799995:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b2835376d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.800003:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b2835376d2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.800011:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b2835376d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.800026:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dca00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832199.800032:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b2835376d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.800041:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b2835376d2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.800057:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:3.0:1788832199.800060:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832199.800065:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b2835376d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.800072:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b2835376d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.800088:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b2835376d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.800094:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b2835376d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.800100:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b2835376d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.800105:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832199.800108:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b2835376d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.800115:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b2835376d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.800134:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2c0ad05000) 00010000:00010000:3.0:1788832199.800137:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832199.800140:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b2835376d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.800146:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b2835376d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.800201:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b2835376cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04760 expref: 33 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.800217:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b2835376e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04760 expref: 32 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.800225:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c39194d00) 00010000:00010000:3.0:1788832199.800228:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788832199.800231:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dd600, rc 0) 00000100:00100000:3.0:1788832199.800326:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+32:11337:x1875726202622336:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1195us (1550us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788832199.800336:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 103 00000100:00100000:2.0:1788832199.807329:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832199.810705:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202622464 00000100:00100000:3.0:1788832199.810730:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202622464 00000100:00100000:3.0:1788832199.810892:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 104 00000100:00100000:3.0:1788832199.810907:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+32:11337:x1875726202622464:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:3.0:1788832199.811016:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835376ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.811039:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537685 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04744 expref: 32 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.811075:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835376ee lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.811126:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537685 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04744 expref: 32 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.811143:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537685 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04744 expref: 32 pid: 6526 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832199.811163:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1875726218424320:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788832199.811303:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832199.815872:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832199.816071:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1875726218424320:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788832199.816110:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835376ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832199.816275:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202622720 00000100:00100000:0.0:1788832199.816285:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202622720 00000100:00100000:0.0:1788832199.816374:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:0.0:1788832199.816386:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+33:6166:x1875726202622720:12345-192.168.203.26@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788832199.816859:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+34:6166:x1875726202622720:12345-192.168.203.26@tcp:35:ldlm_bl.0 Request processed in 473us (998us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788832199.816868:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:0.0:1788832199.826563:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832199.826678:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202622848 00000100:00100000:2.0:1788832199.826693:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202622848 00010000:00010000:2.0:1788832199.826751:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537685 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04744 expref: 34 pid: 6526 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832199.826813:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:2.0:1788832199.826826:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+34:2394:x1875726202622848:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832199.826846:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832199.826855:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537685 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04744 expref: 34 pid: 6526 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832199.826871:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537685 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04744 expref: 34 pid: 6526 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832199.826900:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537685 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04744 expref: 34 pid: 6526 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832199.826917:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c39194d00) 00010000:00010000:2.0:1788832199.826921:0:10343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835376ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832199.826930:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835376ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832199.826954:0:10343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835376ee lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832199.826986:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832199.827070:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+33:2394:x1875726202622848:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 246us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832199.827079:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 66 00010000:00010000:3.0:1788832199.827548:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835376ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.827561:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835376ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.827615:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835376ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.827677:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835376ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.827685:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835376ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.827702:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832199.827708:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835376ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.827716:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835376ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.827729:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c39194d00) 00010000:00010000:3.0:1788832199.827732:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788832199.827737:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835376ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832199.827743:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835376ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832199.827822:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+32:11337:x1875726202622464:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 16917us (20518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832199.827831:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 104 00000100:00100000:0.0:1788832199.831833:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832199.832105:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202623104 00000100:00100000:3.0:1788832199.832120:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202623104 00000100:00100000:3.0:1788832199.832196:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:3.0:1788832199.832208:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+32:11337:x1875726202623104:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788832199.832687:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+33:11337:x1875726202623104:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 479us (872us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788832199.832697:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:2.0:1788832199.900265:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832199.900324:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832199.900429:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202623360 00000100:00100000:3.0:1788832199.900441:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202623360 00000100:00100000:3.0:1788832199.900523:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:3.0:1788832199.900553:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+8:2396:x1875726202623360:12345-192.168.203.26@tcp:16:kworker.0 00000100:00100000:1.0:1788832199.901458:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202623232 00000100:00100000:1.0:1788832199.901480:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202623232 00002000:00100000:1.0:1788832199.901527:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->7) req@ffff9d2c3fc1aa00 x1875726202623232/t0(0) o4->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:140/0 lens 496/0 e 0 to 0 dl 1788832210 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788832199.901540:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2c3fc1aa00 with x1875726202623232 ext(0->7) 00002000:00010000:1.0:1788832199.901547:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d2c3fc1aa00 00000100:00100000:1.0:1788832199.901582:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:1.0:1788832199.901591:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:352fff76-09db-42cd-818a-16e788a01abb+9:2396:x1875726202623232:12345-192.168.203.26@tcp:4:bash.0 00000100:00100000:1.0:1788832199.905173:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:352fff76-09db-42cd-818a-16e788a01abb+11:2396:x1875726202623232:12345-192.168.203.26@tcp:4:bash.0 Request processed in 3566us (4907us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788832199.905193:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 2 00002000:00100000:1.0:1788832199.905209:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->7) req@ffff9d2c3fc1aa00 x1875726202623232/t4294967308(0) o4->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:140/0 lens 496/448 e 0 to 0 dl 1788832210 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788832199.905221:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2c3fc1aa00 with x1875726202623232 ext(0->7) 00002000:00010000:1.0:1788832199.905230:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d2c3fc1aa00 00000001:00080000:2.0:1788832199.906802:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1788832199.906828:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:3.0:1788832199.908837:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+8:2396:x1875726202623360:12345-192.168.203.26@tcp:16:kworker.0 Request processed in 8272us (8498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832199.908853:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:0.0:1788832199.957739:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832199.957864:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202623616 00000100:00100000:1.0:1788832199.957878:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202623616 00000100:00100000:1.0:1788832199.959212:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 105 00000100:00100000:1.0:1788832199.959261:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+33:11348:x1875726202623616:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:1.0:1788832199.959299:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832199.959330:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835376f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04767 expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.960168:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835376fc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.960190:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835376fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.960207:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835376fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.960226:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537703 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.960235:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537703 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.960242:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537703 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.960540:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b28353770a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.960551:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b28353770a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.960560:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b28353770a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832199.960589:0:8742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788832199.960990:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835376fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.960999:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835376fc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.961006:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835376fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.961013:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832199.961018:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835376fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.961026:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835376fc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.961041:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:1.0:1788832199.961045:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832199.961050:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835376fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.961057:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835376fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.961073:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537703 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.961078:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537703 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.961095:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537703 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.961101:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832199.961104:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537703 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.961111:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537703 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.961119:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2b073ae600) 00010000:00010000:1.0:1788832199.961122:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832199.961124:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537703 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.961130:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537703 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.961190:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835376f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04767 expref: 36 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.961204:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b28353770a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04767 expref: 35 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832199.961211:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c39194d00) 00010000:00010000:1.0:1788832199.961213:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832199.961215:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe200, rc 0) 00000100:00100000:1.0:1788832199.961378:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+35:11348:x1875726202623616:12345-192.168.203.26@tcp:101:cat.0 Request processed in 2128us (3654us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788832199.961397:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 105 00000100:00100000:0.0:1788832199.968535:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832199.968655:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202623872 00000100:00100000:2.0:1788832199.968669:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202623872 00000100:00100000:2.0:1788832199.968745:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:2.0:1788832199.968767:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+35:11348:x1875726202623872:12345-192.168.203.26@tcp:35:cat.0 00000100:00100000:2.0:1788832199.969203:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+36:11348:x1875726202623872:12345-192.168.203.26@tcp:35:cat.0 Request processed in 446us (684us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788832199.969211:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:2.0:1788832200.004172:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832200.004269:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202624128 00000100:00100000:3.0:1788832200.004282:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202624128 00000100:00100000:3.0:1788832200.004363:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 106 00000100:00100000:3.0:1788832200.004375:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+36:11349:x1875726202624128:12345-192.168.203.26@tcp:36:rm.0 00010000:00010000:3.0:1788832200.004491:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788832200.004532:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b2835376a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04752 expref: 36 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.004563:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b28353770a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04767 expref: 35 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.004578:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b2835376e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04760 expref: 34 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.004591:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353769a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0474b expref: 33 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.004602:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c39194d00) 00010000:00010000:3.0:1788832200.004608:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788832200.004680:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537718 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.004696:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537718 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.004716:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537718 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.004735:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b28353771f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.004742:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b28353771f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.004750:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b28353771f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.004859:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537726 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.004869:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537726 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.004876:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537726 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788832200.005142:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1788832200.005152:0:6527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 340045530220ns, next at 341045527910ns, rc = 0 00010000:00010000:3.0:1788832200.005203:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b28353772d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.005211:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b28353772d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.005220:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b28353772d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.005238:0:6527:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b28353772d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.005245:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b28353772d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.005251:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b28353772d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.005267:0:6527:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788832200.005289:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537726 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.005294:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537726 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.005300:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537726 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.005306:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832200.005311:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537726 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.005319:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537726 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.005328:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c39194d00) 00010000:00010000:3.0:1788832200.005331:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788832200.005335:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537726 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.005350:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537726 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.005365:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537718 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.005372:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537718 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.005378:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537718 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.005383:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832200.005387:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537718 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.005393:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537718 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.005401:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:3.0:1788832200.005403:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832200.005407:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537718 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.005413:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537718 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788832200.005422:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000955c0d8a reply state 000000009dcd0521 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b28353771f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.005433:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b28353771f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.005453:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2c0ad05000) 00010000:00010000:3.0:1788832200.005455:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788832200.005458:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788832200.005553:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+34:11349:x1875726202624128:12345-192.168.203.26@tcp:36:rm.0 Request processed in 1179us (1405us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788832200.005561:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 106 00010000:00010000:1.0:1788832200.006099:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832200.006108:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b28353772d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.006116:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dca00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:1.0:1788832200.006120:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b28353772d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.006128:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b28353772d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.006138:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c39194d00) 00010000:00010000:1.0:1788832200.006140:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788832200.006143:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b28353772d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.006149:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b28353772d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.006163:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832200.006164:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832200.006166:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832200.061987:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832200.062174:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202624384 00000100:00100000:3.0:1788832200.062189:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202624384 00000100:00100000:3.0:1788832200.062275:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 107 00000100:00100000:3.0:1788832200.062289:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+34:11355:x1875726202624384:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788832200.062325:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832200.062353:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537734 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0476e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.062524:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353773b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.062546:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353773b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.062562:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353773b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.062575:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537742 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.062583:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537742 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.062610:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537742 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788832200.063306:0:6526:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788832200.064119:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537749 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.064138:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537749 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.064150:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537749 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.064207:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353773b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.064215:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353773b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.064223:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353773b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.064230:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832200.064236:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353773b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.064245:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353773b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.064260:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:3.0:1788832200.064264:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832200.064283:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353773b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.064290:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353773b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788832200.064308:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080ec4f0d reply state 0000000060df78fa transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537742 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.064322:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537742 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.064329:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2c0ad05000) 00010000:00010000:3.0:1788832200.064332:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788832200.064335:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788832200.065038:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537734 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0476e expref: 37 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.065062:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537749 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0476e expref: 36 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.065071:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2c0ad05f00) 00010000:00010000:3.0:1788832200.065073:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788832200.065076:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dd600, rc 0) 00000100:00100000:3.0:1788832200.065174:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+37:11355:x1875726202624384:12345-192.168.203.26@tcp:101:bash.0 Request processed in 2886us (3208us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788832200.065185:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 107 00000100:00100000:3.0:1788832200.069286:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832200.069409:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202624512 00000100:00100000:1.0:1788832200.069423:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202624512 00000100:00100000:1.0:1788832200.069513:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:1.0:1788832200.069525:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:352fff76-09db-42cd-818a-16e788a01abb+7:2396:x1875726202624512:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1788832200.069550:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832200.069579:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b283537757 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04775 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788832200.069668:0:10099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832200.069696:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:1.0:1788832200.069702:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832200.069714:0:10099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b283537757 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04775 expref: 8 pid: 10099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.069740:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b283537757 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04775 expref: 8 pid: 10099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.069771:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe800, rc 0) 00000100:00100000:1.0:1788832200.069863:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:352fff76-09db-42cd-818a-16e788a01abb+8:2396:x1875726202624512:12345-192.168.203.26@tcp:101:bash.0 Request processed in 339us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832200.069872:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:0.0:1788832200.073970:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832200.074070:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202624640 00000100:00100000:3.0:1788832200.074084:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202624640 00000100:00100000:3.0:1788832200.074174:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:3.0:1788832200.074186:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+8:11355:x1875726202624640:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788832200.074213:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832200.074238:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ad11bf9/0x998c12b28353775e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0477c expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.074278:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b283537757 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04775 expref: 9 pid: 10099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.074289:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832200.074295:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832200.074301:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ad11bf9/0x998c12b28353775e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0477c expref: 9 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.074346:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b283537757 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04775 expref: 9 pid: 10099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.074376:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b283537757 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04775 expref: 9 pid: 10099 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832200.074393:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8442:1875726218424448:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788832200.074523:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788832200.078982:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832200.079107:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8442:1875726218424448:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788832200.079154:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ad11bf9/0x998c12b28353775e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0477c expref: 9 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.079223:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092ddc00, rc 0) 00000100:00100000:3.0:1788832200.079304:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+9:11355:x1875726202624640:12345-192.168.203.26@tcp:101:bash.0 Request processed in 5119us (5346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832200.079315:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:0.0:1788832200.079655:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202624768 00000100:00100000:0.0:1788832200.079666:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202624768 00010000:00010000:0.0:1788832200.079711:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b283537757 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04775 expref: 9 pid: 10099 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832200.079764:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:0.0:1788832200.079785:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+9:2394:x1875726202624768:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832200.079802:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832200.079830:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b283537757 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04775 expref: 9 pid: 10099 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.079846:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b283537757 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04775 expref: 9 pid: 10099 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.079876:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b283537757 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04775 expref: 9 pid: 10099 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.079894:0:10344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832200.079899:0:10344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832200.079909:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ad11bf9/0x998c12b28353775e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0477c expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.079922:0:10344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ad11bf9/0x998c12b28353775e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0477c expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.079963:0:10344:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ad11bf9/0x998c12b28353775e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0477c expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832200.079982:0:10344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fde2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10344:1875726218424576:192.168.203.26@tcp:105: 00000100:00100000:0.0:1788832200.080055:0:10344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788832200.084765:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832200.084890:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202625024 00000100:00100000:2.0:1788832200.084903:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202625024 00000100:00100000:2.0:1788832200.084979:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:2.0:1788832200.084992:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+37:11355:x1875726202625024:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:2.0:1788832200.085440:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+38:11355:x1875726202625024:12345-192.168.203.26@tcp:35:bash.0 Request processed in 449us (696us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788832200.085482:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:0.0:1788832200.089963:0:10344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fde2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10344:1875726218424576:192.168.203.26@tcp:105: 00010000:00010000:0.0:1788832200.090030:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832200.090126:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+8:2394:x1875726202624768:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 10340us (11156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832200.090140:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 67 00010000:00010000:2.0:1788832200.150930:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832200.274196:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832200.274333:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202625152 00000100:00100000:0.0:1788832200.274347:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202625152 00000100:00100000:0.0:1788832200.274442:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 108 00000100:00100000:0.0:1788832200.274456:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+38:11371:x1875726202625152:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788832200.274492:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832200.274520:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b283537765 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04783 expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.274612:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b28353776c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.274675:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b28353776c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.274689:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b28353776c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832200.274751:0:8742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788832200.274767:0:8742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788832200.274792:0:8742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b28353776c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.274822:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b283537765 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04783 expref: 40 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.274844:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b28353776c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04783 expref: 39 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.274873:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:0.0:1788832200.274877:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788832200.274881:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0d200, rc 0) 00000100:00100000:0.0:1788832200.275389:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+39:11371:x1875726202625152:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 931us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832200.275398:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 108 00000100:00100000:2.0:1788832200.284707:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832200.284826:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202625408 00000100:00100000:0.0:1788832200.284841:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202625408 00000100:00100000:0.0:1788832200.284924:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 109 00000100:00100000:0.0:1788832200.284948:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+39:11371:x1875726202625408:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788832200.284979:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832200.285009:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b283537773 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0478a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.285191:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d400/0x998c12b28353777a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.285211:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d400/0x998c12b28353777a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.285225:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d400/0x998c12b28353777a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832200.285239:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788832200.285400:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b283537773 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0478a expref: 42 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.285452:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d400/0x998c12b28353777a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0478a expref: 41 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.285462:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2c0ad05f00) 00010000:00010000:0.0:1788832200.285465:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788832200.285470:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0d400, rc 0) 00000100:00100000:0.0:1788832200.285555:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+41:11371:x1875726202625408:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 611us (862us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788832200.285564:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 109 00000100:00100000:2.0:1788832200.299791:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832200.299894:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202625792 00000100:00100000:0.0:1788832200.299908:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202625792 00000100:00100000:0.0:1788832200.300010:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:0.0:1788832200.300025:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+41:2393:x1875726202625792:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832200.300048:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788832200.300496:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832200.300665:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202625664 00000100:00100000:1.0:1788832200.300671:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202625664 00000100:00100000:1.0:1788832200.300719:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 110 00000100:00100000:1.0:1788832200.300727:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+42:11371:x1875726202625664:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788832200.300768:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832200.300789:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537788 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04791 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.300917:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b28353778f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.300957:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b28353778f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.300969:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b28353778f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832200.300985:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788832200.301615:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537788 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04791 expref: 45 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.301699:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b28353778f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04791 expref: 44 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.301708:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2c0ad05f00) 00010000:00010000:1.0:1788832200.301711:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788832200.301716:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cffa00, rc 0) 00000100:00100000:1.0:1788832200.301810:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+44:11371:x1875726202625664:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1083us (1316us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1788832200.301818:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 110 00010000:00010000:0.0:1788832200.302548:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d400/0x998c12b28353777a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0478a expref: 43 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.302573:0:7466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2c0ad05f00) 00010000:00010000:0.0:1788832200.302579:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832200.302667:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+42:2393:x1875726202625792:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 2645us (2889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832200.302676:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:0.0:1788832200.313913:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832200.313992:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202625920 00000100:00100000:3.0:1788832200.314005:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202625920 00000100:00100000:3.0:1788832200.314073:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00100000:3.0:1788832200.314083:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+8:2393:x1875726202625920:12345-192.168.203.26@tcp:1:lfs.0 00010000:00010000:3.0:1788832200.314146:0:10097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b28353779d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.314339:0:10097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ad11bf9/0x998c12b28353775e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0477c expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.314357:0:10097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832200.314362:0:10097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788832200.314368:0:10097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b28353779d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.314422:0:10097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ad11bf9/0x998c12b28353775e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0477c expref: 8 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.314438:0:10097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ad11bf9/0x998c12b28353775e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0477c expref: 8 pid: 8442 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832200.314486:0:10097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10097:1875726218424704:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788832200.314664:0:10097:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f5300 going to sleep for 11 seconds 00000100:00100000:3.0:1788832200.321905:0:10097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10097:1875726218424704:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788832200.321949:0:10097:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b28353779d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832200.327950:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832200.328679:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202626048 00000100:00100000:2.0:1788832200.328696:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202626048 00002000:00100000:2.0:1788832200.328789:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9d2c3fde0380 x1875726202626048/t0(0) o4->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:141/0 lens 504/0 e 0 to 0 dl 1788832211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788832200.328802:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2c3fde0380 with x1875726202626048 ext(0->8) 00010000:00010000:2.0:1788832200.328813:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ad11bf9/0x998c12b28353775e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0477c expref: 9 pid: 8442 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.328835:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ad11bf9/0x998c12b28353775e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0477c expref: 9 pid: 8442 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788832200.328845:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d2c3fde0380 00000100:00100000:2.0:1788832200.328892:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:2.0:1788832200.328903:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:352fff76-09db-42cd-818a-16e788a01abb+9:2393:x1875726202626048:12345-192.168.203.26@tcp:4:lfs.0 00000100:00100000:2.0:1788832200.330496:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:352fff76-09db-42cd-818a-16e788a01abb+11:2393:x1875726202626048:12345-192.168.203.26@tcp:4:lfs.0 Request processed in 1582us (2547us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788832200.330511:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1 00002000:00100000:2.0:1788832200.330526:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9d2c3fde0380 x1875726202626048/t4294967303(0) o4->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:141/0 lens 504/448 e 0 to 0 dl 1788832211 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788832200.330537:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2c3fde0380 with x1875726202626048 ext(0->8) 00010000:00010000:2.0:1788832200.330567:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ad11bf9/0x998c12b28353775e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0477c expref: 11 pid: 8442 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.330590:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ad11bf9/0x998c12b28353775e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0477c expref: 11 pid: 8442 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788832200.330599:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d2c3fde0380 00000001:00080000:2.0:1788832200.339779:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1788832200.339798:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1788832200.343028:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832200.343140:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202626176 00000100:00100000:2.0:1788832200.343158:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202626176 00010000:00010000:2.0:1788832200.343212:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ad11bf9/0x998c12b28353775e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0477c expref: 7 pid: 8442 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832200.343269:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:2.0:1788832200.343283:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c09478850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+7:2395:x1875726202626176:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832200.343299:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788832200.343320:0:10343:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788832200.343323:0:10343:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788832200 00002000:00010000:2.0:1788832200.343325:0:10343:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788832200 00002000:00010000:2.0:1788832200.343327:0:10343:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788832200 00002000:00010000:2.0:1788832200.343328:0:10343:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788832200.343334:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ad11bf9/0x998c12b28353775e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0477c expref: 7 pid: 8442 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.343349:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ad11bf9/0x998c12b28353775e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0477c expref: 7 pid: 8442 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.343396:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ad11bf9/0x998c12b28353775e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0477c expref: 7 pid: 8442 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.343417:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832200.343421:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832200.343427:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b28353779d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.343436:0:10343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b28353779d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.343468:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832200.343531:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c09478850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+6:2395:x1875726202626176:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 253us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832200.343540:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 68 00010000:00010000:1.0:1788832200.343570:0:10097:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b28353779d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.343588:0:10097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b28353779d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.343659:0:10097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b28353779d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.343684:0:10097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b28353779d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.343693:0:10097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b28353779d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.343701:0:10097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc200 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:1.0:1788832200.343706:0:10097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b28353779d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.343717:0:10097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b28353779d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.343738:0:10097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b28353779d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.343746:0:10097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b28353779d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832200.343840:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202625920:12345-192.168.203.26@tcp:1:lfs.0 Request processed in 29755us (29937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832200.343850:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00100000:1.0:1788832200.347488:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832200.347706:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202626432 00000100:00100000:2.0:1788832200.347721:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202626432 00000100:00100000:2.0:1788832200.347796:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:2.0:1788832200.347808:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18f2b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+42:11371:x1875726202626432:12345-192.168.203.26@tcp:35:lfs.0 00000004:00010000:2.0:1788832200.347892:0:6529:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b28353778f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04791 expref: 42 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788832200.348276:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1788832200.348314:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788832200.348925:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1788832200.348978:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835377a4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.349013:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537749 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0476e expref: 46 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.349022:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835377a4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.349069:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537749 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0476e expref: 46 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.350523:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537749 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0476e expref: 46 pid: 6526 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832200.350553:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c04dc6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6529:1875726218424832:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788832200.350944:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376540 going to sleep for 11 seconds 00000100:00100000:0.0:1788832200.373212:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832200.373257:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c04dc6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6529:1875726218424832:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832200.373297:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835377a4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832200.373396:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202626560 00000100:00100000:3.0:1788832200.373407:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202626560 00010000:00010000:3.0:1788832200.373456:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537749 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0476e expref: 47 pid: 6526 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832200.373510:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:3.0:1788832200.373522:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+47:2394:x1875726202626560:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832200.373541:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832200.373549:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537749 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0476e expref: 47 pid: 6526 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.373563:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537749 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0476e expref: 47 pid: 6526 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.373816:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537749 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0476e expref: 47 pid: 6526 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.373835:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2c0ad05f00) 00010000:00010000:3.0:1788832200.373849:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835377a4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.373862:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835377a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.373871:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835377a4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.373907:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832200.373976:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+46:2394:x1875726202626560:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 456us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832200.373986:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 69 00010000:00010000:2.0:1788832200.374058:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835377a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.374066:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835377a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788832200.374232:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1788832200.374383:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1788832200.374780:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c04dc6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1875726218424960:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788832200.374871:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832200.374913:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376300 going to sleep for 11 seconds 00000100:00100000:0.0:1788832200.375108:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218424960 00000100:00100000:0.0:1788832200.375119:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218424960 00000100:00100000:0.0:1788832200.375204:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788832200.375216:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6529:x1875726218424960:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788832200.375333:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6529:x1875726218424960:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 119us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832200.375342:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788832200.375559:0:6529:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:1.0:1788832200.375566:0:6529:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:1.0:1788832200.375607:0:6529:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d2c36c88700, transno 4294967302 00000100:00100000:1.0:1788832200.375649:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c04dc6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1875726218424960:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788832200.375798:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1788832200.375856:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1875726218425088:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788832200.375913:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832200.376073:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7540 going to sleep for 11 seconds 00000100:00080000:2.0:1788832200.376138:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788832200.376453:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218425088 00000100:00100000:3.0:1788832200.376460:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218425088 00000100:00100000:3.0:1788832200.376508:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788832200.376517:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6529:x1875726218425088:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788832200.392228:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6529:x1875726218425088:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 15698us (16300us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788832200.392247:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788832200.392398:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1875726218425088:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788832200.392517:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1788832200.392602:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835377a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.392614:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835377a4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.392652:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835377a4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.392659:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832200.392665:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835377a4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.392673:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835377a4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.392694:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2c0ad05f00) 00010000:00010000:0.0:1788832200.392697:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788832200.392703:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835377a4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.392732:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835377a4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788832200.392901:0:6529:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788832200.392976:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1788832200.392988:0:6529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340433367041ns, next at 341433364701ns, rc = 0 00000001:00080000:0.0:1788832200.392995:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1788832200.393021:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2c0ad05f00) 00010000:00010000:0.0:1788832200.393025:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788832200.393032:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b28353778f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04791 expref: 50 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832200.393170:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18f2b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+49:11371:x1875726202626432:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 45363us (45698us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788832200.393180:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 26 00000020:00080000:0.0:1788832200.393184:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788832200.399173:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832200.399283:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202626688 00000100:00100000:1.0:1788832200.399298:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202626688 00000100:00100000:1.0:1788832200.399382:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 111 00000100:00100000:1.0:1788832200.399395:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+49:11371:x1875726202626688:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788832200.399430:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832200.399463:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835377ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04798 expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.399544:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835377ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04798 expref: 50 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.399562:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835377ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04798 expref: 50 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.399583:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:1.0:1788832200.399586:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788832200.399590:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cff400, rc 0) 00000100:00100000:1.0:1788832200.399699:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+50:11371:x1875726202626688:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 307us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832200.399707:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 111 00000100:00100000:2.0:1788832200.405412:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832200.405888:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202626944 00000100:00100000:1.0:1788832200.405902:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202626944 00000100:00100000:1.0:1788832200.406001:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:1.0:1788832200.406012:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+50:11371:x1875726202626944:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1788832200.406348:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+51:11371:x1875726202626944:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 336us (949us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788832200.406367:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:2.0:1788832200.494775:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832200.494856:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202627072 00000100:00100000:3.0:1788832200.494869:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202627072 00000100:00100000:3.0:1788832200.494946:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 112 00000100:00100000:3.0:1788832200.494957:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+51:11381:x1875726202627072:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:3.0:1788832200.495056:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b2835377b2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495076:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b2835377b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495102:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b2835377b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495133:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835377b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495141:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835377b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495147:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835377b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495261:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835377c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495270:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835377c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495278:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835377c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788832200.495343:0:13811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835377c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495367:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b2835377b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495374:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b2835377b2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495393:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b2835377b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495400:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dd600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832200.495405:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b2835377b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495419:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b2835377b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495434:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:3.0:1788832200.495438:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832200.495443:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b2835377b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495449:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b2835377b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495465:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835377b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495471:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835377b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495477:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835377b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495482:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832200.495485:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835377b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495492:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835377b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495501:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2c0ad05000) 00010000:00010000:3.0:1788832200.495504:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832200.495507:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835377b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495522:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b2835377b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495533:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835377c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495538:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835377c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495543:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835377c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495548:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832200.495552:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835377c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495558:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835377c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495566:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:3.0:1788832200.495568:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832200.495571:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835377c0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.495577:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b2835377c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832200.495744:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+51:11381:x1875726202627072:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 781us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832200.495762:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 112 00000100:00100000:3.0:1788832200.538282:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832200.540504:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202627328 00000100:00100000:0.0:1788832200.540526:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202627328 00000100:00100000:0.0:1788832200.540661:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 113 00000100:00100000:0.0:1788832200.540674:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+51:11384:x1875726202627328:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788832200.540701:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832200.540729:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d400/0x998c12b2835377c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0479f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.540839:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b2835377ce lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.540878:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b2835377ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.540893:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b2835377ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.540908:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835377d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.540916:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835377d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.540923:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835377d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.541200:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b2835377dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.541210:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b2835377dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.541220:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b2835377dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832200.541232:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788832200.541344:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b2835377ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.541353:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b2835377ce lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.541360:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b2835377ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.541374:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0d600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832200.541380:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b2835377ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.541388:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b2835377ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.541405:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:0.0:1788832200.541408:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832200.541414:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b2835377ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.541422:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b2835377ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.541440:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835377d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.541447:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835377d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.541453:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835377d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.541459:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0dc00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832200.541462:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835377d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.541468:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835377d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.541488:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2c0ad05000) 00010000:00010000:0.0:1788832200.541492:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832200.541495:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835377d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.541502:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835377d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.541549:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d400/0x998c12b2835377c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0479f expref: 54 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.541564:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b2835377dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0479f expref: 53 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.541573:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:0.0:1788832200.541575:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788832200.541578:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0c800, rc 0) 00000100:00100000:0.0:1788832200.541731:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+53:11384:x1875726202627328:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1058us (3462us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788832200.541740:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 113 00000100:00100000:0.0:1788832200.547778:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832200.548508:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202627456 00000100:00100000:2.0:1788832200.548525:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202627456 00000100:00100000:2.0:1788832200.548818:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 114 00000100:00100000:2.0:1788832200.548835:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+53:11384:x1875726202627456:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:2.0:1788832200.548933:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b2835377ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.548955:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b2835377ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.548970:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b2835377ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.549015:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b2835377ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.549022:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b2835377ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.549030:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b2835377ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.549038:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031c00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832200.549458:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b2835377ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.549469:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b2835377ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.549487:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:2.0:1788832200.549491:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788832200.549496:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b2835377ea lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.549504:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b2835377ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832200.549698:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+53:11384:x1875726202627456:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 866us (1941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832200.552827:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 114 00000100:00100000:3.0:1788832200.562195:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832200.562696:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202627712 00000100:00100000:1.0:1788832200.562710:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202627712 00000100:00100000:1.0:1788832200.562808:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:1.0:1788832200.562821:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+53:11384:x1875726202627712:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1788832200.565252:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+54:11384:x1875726202627712:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 2418us (3124us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1788832200.565268:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:3.0:1788832200.685222:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832200.685348:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202627968 00000100:00100000:0.0:1788832200.685364:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202627968 00000100:00100000:0.0:1788832200.685463:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 115 00000100:00100000:0.0:1788832200.685476:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+54:11394:x1875726202627968:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1788832200.685510:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832200.685514:0:13811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788832200.685570:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b28353776c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04783 expref: 54 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.685595:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:0.0:1788832200.685601:0:13811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788832200.685699:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835377f1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc047a6 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.685856:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b2835377f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.685873:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b2835377f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.685885:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b2835377f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832200.685898:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788832200.686395:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835377f1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047a6 expref: 56 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.686415:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b2835377f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047a6 expref: 55 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.686424:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:0.0:1788832200.686428:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788832200.686431:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0d600, rc 0) 00000100:00100000:0.0:1788832200.686524:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+55:11394:x1875726202627968:12345-192.168.203.26@tcp:101:bash.0 Request processed in 1050us (1311us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788832200.686532:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 115 00000100:00100000:0.0:1788832200.691316:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832200.691420:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202628096 00000100:00100000:1.0:1788832200.691434:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202628096 00000100:00100000:1.0:1788832200.691529:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 116 00000100:00100000:1.0:1788832200.691543:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+55:11394:x1875726202628096:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1788832200.691578:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832200.691608:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537806 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc047ad expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.691720:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b28353780d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.691741:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b28353780d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.691774:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b28353780d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.691943:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537806 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047ad expref: 57 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.691969:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b28353780d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047ad expref: 56 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.691979:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:1.0:1788832200.691991:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788832200.691996:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cffa00, rc 0) 00000100:00100000:1.0:1788832200.692081:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+56:11394:x1875726202628096:12345-192.168.203.26@tcp:101:bash.0 Request processed in 541us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832200.692089:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 116 00000100:00100000:3.0:1788832200.693543:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832200.693661:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202628224 00000100:00100000:2.0:1788832200.693677:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202628224 00000100:00100000:2.0:1788832200.693762:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:2.0:1788832200.693774:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+56:2396:x1875726202628224:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832200.693792:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832200.693823:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b2835377f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047a6 expref: 56 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.693845:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:2.0:1788832200.693850:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832200.693920:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+55:2396:x1875726202628224:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 147us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832200.693947:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:0.0:1788832200.696535:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832200.698787:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202628480 00000100:00100000:2.0:1788832200.698807:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202628480 00000100:00100000:2.0:1788832200.699114:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 117 00000100:00100000:2.0:1788832200.699129:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+55:11394:x1875726202628480:12345-192.168.203.26@tcp:36:bash.0 00010000:00010000:2.0:1788832200.699201:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832200.699235:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b2835377dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0479f expref: 55 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.699260:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:2.0:1788832200.699267:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788832200.699486:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537814 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.699503:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537814 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.699515:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537814 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788832200.699565:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1788832200.699601:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003eb8436d reply state 000000007d358063 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537814 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.699614:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537814 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832200.699759:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:2.0:1788832200.699763:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788832200.699784:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788832200.700508:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+57:11394:x1875726202628480:12345-192.168.203.26@tcp:36:bash.0 Request processed in 1375us (4070us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788832200.700520:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 117 00000020:00080000:2.0:1788832200.700526:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788832200.706932:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832200.710270:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202628608 00000100:00100000:0.0:1788832200.710295:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202628608 00000100:00100000:0.0:1788832200.710387:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 118 00000100:00100000:0.0:1788832200.710400:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+57:11394:x1875726202628608:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1788832200.710433:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832200.710464:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353781b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc047b4 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.710594:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537822 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.710614:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.710649:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832200.710687:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788832200.710692:0:13811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788832200.710717:0:13811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.710764:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b28353781b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047b4 expref: 59 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.710787:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537822 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047b4 expref: 58 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.710822:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:0.0:1788832200.710825:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788832200.710829:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0cc00, rc 0) 00000100:00100000:0.0:1788832200.711080:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+58:11394:x1875726202628608:12345-192.168.203.26@tcp:101:bash.0 Request processed in 681us (4161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832200.711089:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 118 00000100:00100000:3.0:1788832200.723584:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832200.727436:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202628864 00000100:00100000:0.0:1788832200.727460:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202628864 00000100:00100000:0.0:1788832200.727955:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:0.0:1788832200.727969:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+58:11394:x1875726202628864:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:0.0:1788832200.729322:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+59:11394:x1875726202628864:12345-192.168.203.26@tcp:35:bash.0 Request processed in 1346us (5744us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788832200.729334:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:3.0:1788832200.806341:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832200.806585:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202628992 00000100:00100000:1.0:1788832200.806598:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202628992 00000100:00100000:1.0:1788832200.806712:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 119 00000100:00100000:1.0:1788832200.806725:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+59:11400:x1875726202628992:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788832200.806769:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832200.806798:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537829 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc047bb expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.806889:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537830 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.806908:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537830 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.806946:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537830 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832200.807012:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788832200.807017:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788832200.807044:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537830 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.807078:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537829 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047bb expref: 61 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.807102:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537830 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047bb expref: 60 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.807112:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:1.0:1788832200.807115:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788832200.807120:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfee00, rc 0) 00000100:00100000:1.0:1788832200.807214:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+60:11400:x1875726202628992:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 491us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832200.807222:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 119 00000100:00100000:2.0:1788832200.813578:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832200.821583:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202629120 00000100:00100000:0.0:1788832200.823073:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202629120 00000100:00100000:0.0:1788832200.823195:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 120 00000100:00100000:0.0:1788832200.823209:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+60:11400:x1875726202629120:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788832200.823239:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832200.823278:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537837 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc047c2 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.823369:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b28353783e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.823388:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b28353783e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.823421:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b28353783e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.823438:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537845 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.823446:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.823452:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.824882:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b28353784c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.824910:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b28353784c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.824922:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b28353784c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832200.826117:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788832200.826128:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788832200.826179:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b28353784c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.826200:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b28353784c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.826213:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b28353783e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.826250:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b28353783e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.826259:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b28353783e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.826266:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832200.826271:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b28353783e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.826280:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b28353783e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.826298:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:0.0:1788832200.826302:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832200.826308:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b28353783e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.826315:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b28353783e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.826336:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537845 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.826342:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537845 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.826348:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537845 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.826353:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0d800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832200.826362:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537845 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.826368:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537845 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.826377:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2c0ad05000) 00010000:00010000:0.0:1788832200.826379:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832200.826383:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537845 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.826389:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537845 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.826436:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537837 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047c2 expref: 62 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.826452:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b28353784c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047c2 expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.826459:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:0.0:1788832200.826462:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788832200.827612:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0d000, rc 0) 00000100:00100000:0.0:1788832200.827774:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+61:11400:x1875726202629120:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 4563us (14206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832200.827784:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 120 00000100:00100000:2.0:1788832200.836344:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832200.836677:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202629248 00000100:00100000:0.0:1788832200.836691:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202629248 00000100:00100000:2.0:1788832200.836709:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832200.836790:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:0.0:1788832200.836803:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fda8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+61:2396:x1875726202629248:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832200.836841:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832200.836875:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b28353784c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047c2 expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.836897:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:0.0:1788832200.836903:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832200.836980:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fda8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+60:2396:x1875726202629248:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 179us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832200.836999:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:1.0:1788832200.838114:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202629504 00000100:00100000:1.0:1788832200.838126:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202629504 00000100:00100000:1.0:1788832200.838194:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 121 00000100:00100000:1.0:1788832200.838204:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fdaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+60:11400:x1875726202629504:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788832200.838227:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832200.838250:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537853 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc047c9 expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.838425:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353785a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.838442:0:8742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537822 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047b4 expref: 61 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.838451:0:8742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353785a lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.838499:0:8742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537822 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047b4 expref: 61 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.838513:0:8742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537822 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047b4 expref: 61 pid: 13811 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832200.838528:0:8742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ddf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8742:1875726218425216:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788832200.838670:0:8742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3916b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832200.842762:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832200.842873:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202629632 00000100:00100000:0.0:1788832200.842886:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202629632 00010000:00010000:0.0:1788832200.842940:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537822 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047b4 expref: 62 pid: 13811 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832200.842995:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 70 00000100:00100000:0.0:1788832200.843007:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fda9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+62:2394:x1875726202629632:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832200.843024:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832200.843032:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537822 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047b4 expref: 62 pid: 13811 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.843047:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537822 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047b4 expref: 62 pid: 13811 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.843076:0:10344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:0.0:1788832200.843083:0:10344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353785a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.843115:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353785a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.843124:0:10344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353785a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.843148:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832200.843219:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fda9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+62:2394:x1875726202629632:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 213us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832200.843226:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 70 00010000:00010000:1.0:1788832200.843923:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537822 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047b4 expref: 61 pid: 13811 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832200.843953:0:8742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ddf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8742:1875726218425216:192.168.203.26@tcp:104: 00010000:00010000:1.0:1788832200.843994:0:8742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353785a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.844005:0:8742:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353785a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.844027:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353785a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832200.844052:0:8742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788832200.844226:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537853 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047c9 expref: 62 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.844246:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353785a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047c9 expref: 61 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.844255:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:1.0:1788832200.844258:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788832200.844261:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe600, rc 0) 00000100:00100000:1.0:1788832200.844310:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fdaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+61:11400:x1875726202629504:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 6108us (7602us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788832200.844319:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 121 00000100:00100000:2.0:1788832200.853352:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832200.857523:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202629888 00000100:00100000:1.0:1788832200.857546:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202629888 00000100:00100000:1.0:1788832200.857732:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:1.0:1788832200.857747:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+61:11400:x1875726202629888:12345-192.168.203.26@tcp:103:lfs.0 00010000:00010000:1.0:1788832200.857780:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832200.857814:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835377ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04798 expref: 61 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832200.857838:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:1.0:1788832200.857844:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832200.857952:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+60:11400:x1875726202629888:12345-192.168.203.26@tcp:103:lfs.0 Request processed in 209us (4615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832200.857961:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:0.0:1788832200.868315:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832200.868566:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202630016 00000100:00100000:3.0:1788832200.868579:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202630016 00000100:00100000:3.0:1788832200.868687:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 122 00000100:00100000:3.0:1788832200.868700:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+60:11400:x1875726202630016:12345-192.168.203.26@tcp:58:lfs.0 00010000:00010000:3.0:1788832200.868878:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537868 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.868900:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537868 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832200.868914:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537868 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788832200.869219:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788832200.869340:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+60:11400:x1875726202630016:12345-192.168.203.26@tcp:58:lfs.0 Request processed in 641us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832200.873670:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 122 00000100:00100000:3.0:1788832200.874140:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832200.874213:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202630144 00000100:00100000:0.0:1788832200.874231:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202630144 00000100:00100000:0.0:1788832200.874299:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 123 00000100:00100000:0.0:1788832200.874311:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+60:11400:x1875726202630144:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788832200.874339:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832200.874376:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b28353786f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc047d0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.874454:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537868 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.874474:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b28353786f lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047d0 expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.874499:0:6525:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537868 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.874537:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b28353786f lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047d0 expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.874555:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:0.0:1788832200.874558:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788832200.874563:0:6525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b28353786f lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047d0 expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832200.874571:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0d000, rc 0) 00000100:00100000:0.0:1788832200.874692:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+61:11400:x1875726202630144:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 383us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832200.874700:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 123 00010000:00010000:1.0:1788832201.174861:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832201.431842:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fde3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218425344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788832201.431957:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832201.432113:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218425344 00000100:00100000:3.0:1788832201.432124:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218425344 00000100:00100000:3.0:1788832201.432214:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788832201.432225:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218425344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788832201.432284:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788832201.454588:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218425344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 22348us (22615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832201.454608:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788832201.454899:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fde3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218425344:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788832201.815223:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832201.815236:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832201.815268:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788832201.815279:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788832201.815462:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fde0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875726218425472:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788832201.815613:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832201.818235:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fde0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875726218425472:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788832201.821235:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832201.821320:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202630272 00000100:00100000:0.0:1788832201.821333:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202630272 00000100:00100000:0.0:1788832201.821481:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 124 00000100:00100000:0.0:1788832201.821496:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+61:11401:x1875726202630272:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788832201.821537:0:8742:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:2.0:1788832201.821566:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832201.822297:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+61:11401:x1875726202630272:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 799us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832201.822327:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 124 00000100:00100000:3.0:1788832201.828858:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832201.829251:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202630400 00000100:00100000:0.0:1788832201.829266:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202630400 00000100:00100000:0.0:1788832201.829348:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 125 00000100:00100000:0.0:1788832201.829360:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+61:11401:x1875726202630400:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788832201.829460:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537876 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.829480:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537876 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.829493:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537876 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.829512:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b28353787d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.829519:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b28353787d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.829525:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b28353787d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.829553:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537884 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.829562:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.829568:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832201.829685:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788832201.829690:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788832201.829708:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.829721:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537876 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.829729:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537876 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.829737:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537876 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.829754:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0dc00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832201.829760:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537876 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.829769:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537876 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.829784:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d2b073ae800) 00010000:00010000:0.0:1788832201.829787:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832201.829794:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537876 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.829800:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537876 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.830084:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b28353787d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.830107:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b28353787d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.830114:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b28353787d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.830120:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0d800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832201.830123:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b28353787d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.830130:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b28353787d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.830139:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9d2c39194500) 00010000:00010000:0.0:1788832201.830142:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832201.830145:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b28353787d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.830152:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b28353787d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.830170:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537884 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.830176:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537884 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.830182:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537884 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.830187:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832201.830196:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537884 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.830202:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537884 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.830211:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:0.0:1788832201.830214:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832201.830217:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537884 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.830224:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537884 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832201.830319:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+61:11401:x1875726202630400:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 Request processed in 958us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832201.830329:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 125 00000100:00100000:2.0:1788832201.834264:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832201.834388:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202630656 00000100:00100000:3.0:1788832201.834402:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202630656 00000100:00100000:3.0:1788832201.834521:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 126 00000100:00100000:3.0:1788832201.834543:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+61:11401:x1875726202630656:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832201.834573:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832201.834599:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b28353788b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc047d7 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.835280:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537892 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.835299:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537892 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.835313:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537892 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832201.835328:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788832201.835433:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537892 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.835441:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537892 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.835447:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537892 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.835471:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dd600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832201.835477:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537892 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.835486:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537892 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.835501:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:3.0:1788832201.835504:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788832201.835515:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537892 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.835522:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537892 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.835587:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b28353788b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047d7 expref: 63 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.835601:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d2b073ae800) 00010000:00010000:3.0:1788832201.835604:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788832201.835608:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b28353788b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047d7 expref: 63 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.835636:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dc000, rc 0) 00000100:00100000:3.0:1788832201.836337:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+62:11401:x1875726202630656:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 1802us (2086us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1788832201.836347:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 126 00000100:00100000:1.0:1788832201.838615:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832201.839130:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202630784 00000100:00100000:3.0:1788832201.839161:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202630784 00000100:00100000:3.0:1788832201.839242:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 127 00000100:00100000:3.0:1788832201.839255:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+62:11401:x1875726202630784:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788832201.839305:0:13811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788832201.839488:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+62:11401:x1875726202630784:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 235us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832201.839497:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 127 00000100:00100000:2.0:1788832201.849196:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832201.849793:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202631040 00000100:00100000:0.0:1788832201.849807:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202631040 00000100:00100000:0.0:1788832201.849894:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 128 00000100:00100000:0.0:1788832201.849906:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+62:11401:x1875726202631040:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788832201.849934:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832201.849938:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788832201.849976:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537830 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047bb expref: 62 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.850000:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:0.0:1788832201.850005:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788832201.850021:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378a0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc047de expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788832201.850771:0:6527:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788832201.854472:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835378a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.854502:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835378a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.854517:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835378a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.855009:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047de expref: 64 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.855033:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835378a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047de expref: 63 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.855178:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d2c39194500) 00010000:00010000:0.0:1788832201.855181:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788832201.855185:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0d800, rc 0) 00000100:00100000:0.0:1788832201.855325:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+63:11401:x1875726202631040:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 5419us (6143us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788832201.855334:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 128 00000100:00100000:1.0:1788832201.870825:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832201.871110:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202631296 00000100:00100000:0.0:1788832201.871122:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202631296 00000100:00100000:0.0:1788832201.871212:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 129 00000100:00100000:0.0:1788832201.871223:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+63:11401:x1875726202631296:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788832201.871279:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832201.871315:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835378a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047de expref: 63 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.871332:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d2c39194500) 00010000:00010000:0.0:1788832201.871350:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788832201.871369:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378b5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.871380:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.871389:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.871442:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xa7702c38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.871450:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa7702c38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.871457:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa7702c38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.871502:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378b5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.871514:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378b5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.871521:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378b5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.871527:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832201.871538:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378b5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.871545:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378b5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.871669:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:0.0:1788832201.871673:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832201.871677:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378b5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.871684:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378b5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.871694:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa7702c38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.871780:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378bc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa7702c38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.871785:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa7702c38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.871788:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0dc00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832201.871869:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378bc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa7702c38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.871878:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378bc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa7702c38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.871892:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xa7702c38 (ffff9d2c39194c00) 00010000:00010000:0.0:1788832201.871894:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832201.871904:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378bc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa7702c38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.871910:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378bc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa7702c38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832201.871996:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+62:11401:x1875726202631296:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 773us (1180us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788832201.872004:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 129 00000100:00100000:1.0:1788832201.880878:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832201.880971:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202631424 00000100:00100000:2.0:1788832201.880984:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202631424 00000100:00100000:2.0:1788832201.881060:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 130 00000100:00100000:2.0:1788832201.881070:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+62:11401:x1875726202631424:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788832201.881098:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832201.881126:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835378c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc047e5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832201.881173:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835378ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832201.881190:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835378ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832201.881204:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835378ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832201.881498:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835378c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047e5 expref: 64 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832201.881523:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835378ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047e5 expref: 63 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832201.881531:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:2.0:1788832201.881534:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788832201.881537:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00030600, rc 0) 00000100:00100000:2.0:1788832201.881676:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+63:11401:x1875726202631424:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 553us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832201.881684:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 130 00000100:00100000:2.0:1788832201.887464:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832201.887538:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202631680 00000100:00100000:0.0:1788832201.887553:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202631680 00000100:00100000:0.0:1788832201.887659:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 131 00000100:00100000:0.0:1788832201.887671:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+63:11401:x1875726202631680:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788832201.887790:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.887807:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.887821:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788832201.887991:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1788832201.888002:0:6527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 341928380851ns, next at 342928378096ns, rc = 0 00000004:00010000:0.0:1788832201.888052:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007056842b reply state 00000000d4fc0d44 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.888065:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.888072:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:0.0:1788832201.888089:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788832201.888093:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788832201.888197:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+65:11401:x1875726202631680:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 527us (748us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788832201.888205:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 131 00000100:00100000:3.0:1788832201.890102:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832201.891294:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202631808 00000100:00100000:0.0:1788832201.891310:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202631808 00000100:00100000:0.0:1788832201.891392:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 132 00000100:00100000:0.0:1788832201.891404:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+65:11401:x1875726202631808:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788832201.891428:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832201.891450:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc047ec expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.891510:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047ec expref: 66 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.891525:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047ec expref: 66 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.891543:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:0.0:1788832201.891557:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788832201.891561:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0c400, rc 0) 00000100:00100000:0.0:1788832201.891665:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+66:11401:x1875726202631808:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 262us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832201.891672:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 132 00000100:00100000:1.0:1788832201.896187:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832201.896302:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202631936 00000100:00100000:0.0:1788832201.896314:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202631936 00000100:00100000:0.0:1788832201.896484:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:0.0:1788832201.896516:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+8:2396:x1875726202631936:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788832201.896837:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+9:2396:x1875726202631936:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 324us (663us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788832201.896846:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:3.0:1788832201.901315:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832201.901501:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202632192 00000100:00100000:1.0:1788832201.901515:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202632192 00000100:00100000:1.0:1788832201.901595:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:1.0:1788832201.901607:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+66:11401:x1875726202632192:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788832201.901973:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+67:11401:x1875726202632192:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 366us (673us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1788832201.901982:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00080000:2.0:1788832201.905981:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788832201.908002:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832201.908316:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202632448 00000100:00100000:1.0:1788832201.908330:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202632448 00000100:00100000:1.0:1788832201.908516:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 133 00000100:00100000:1.0:1788832201.908530:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+67:11401:x1875726202632448:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788832201.908816:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+67:11401:x1875726202632448:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 287us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832201.908848:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 133 00000100:00100000:3.0:1788832201.913120:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832201.913259:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202632576 00000100:00100000:0.0:1788832201.913272:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202632576 00000100:00100000:0.0:1788832201.913356:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 134 00000100:00100000:0.0:1788832201.913370:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+67:11401:x1875726202632576:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788832201.913399:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832201.913428:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835378df lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc047f3 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.913528:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b2835378e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.913547:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b2835378e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.913562:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b2835378e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832201.913666:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788832201.913694:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b2835378e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.913726:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b2835378df lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047f3 expref: 69 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.913759:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b2835378e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047f3 expref: 68 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.913788:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:0.0:1788832201.913791:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788832201.913796:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0cc00, rc 0) 00000100:00100000:0.0:1788832201.913882:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+68:11401:x1875726202632576:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 515us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832201.913889:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 134 00000100:00100000:2.0:1788832201.917114:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832201.917342:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202632704 00000100:00100000:3.0:1788832201.917365:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202632704 00000100:00100000:3.0:1788832201.917438:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:3.0:1788832201.917450:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+9:2393:x1875726202632704:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832201.917474:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832201.917501:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098ff7157/0x998c12b2835378ed lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc047fa expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788832201.917531:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f69ca, blocks: 0x0 00010000:00010000:3.0:1788832201.917559:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1788832201.917565:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832201.917575:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098ff7157/0x998c12b2835378ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047fa expref: 10 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.917597:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000098ff7157/0x998c12b2835378ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047fa expref: 10 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.918020:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dc000, rc 0) 00000100:00100000:3.0:1788832201.918140:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+10:2393:x1875726202632704:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 690us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832201.918148:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:2.0:1788832201.921802:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832201.922090:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202632960 00000100:00100000:0.0:1788832201.922102:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202632960 00000100:00100000:0.0:1788832201.922190:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 135 00000100:00100000:0.0:1788832201.922202:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+68:11401:x1875726202632960:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788832201.922358:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+68:11401:x1875726202632960:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 157us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832201.922367:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 135 00000100:00100000:1.0:1788832201.928819:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832201.929066:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202633088 00000100:00100000:3.0:1788832201.929081:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202633088 00000100:00100000:2.0:1788832201.929695:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:2.0:1788832201.929711:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+10:11401:x1875726202633088:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788832201.929751:0:10097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832201.929781:0:10097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b2835378f4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04801 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832201.929830:0:10097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000098ff7157/0x998c12b2835378ed lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047fa expref: 11 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832201.929872:0:10097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832201.929878:0:10097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832201.929885:0:10097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b2835378f4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04801 expref: 11 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832201.929934:0:10097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000098ff7157/0x998c12b2835378ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047fa expref: 11 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832201.929952:0:10097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000098ff7157/0x998c12b2835378ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047fa expref: 11 pid: 8442 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832201.929969:0:10097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07757800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10097:1875726218425600:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788832201.930094:0:10097:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832201.938023:0:10097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07757800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10097:1875726218425600:192.168.203.26@tcp:104: 00010000:00010000:1.0:1788832201.938079:0:10097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b2835378f4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04801 expref: 11 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832201.938108:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00010000:00010000:1.0:1788832201.938108:0:10097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031e00, rc 0) 00000100:00100000:1.0:1788832201.938189:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+11:11401:x1875726202633088:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 8482us (9383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832201.938204:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:0.0:1788832201.938364:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202633216 00000100:00100000:0.0:1788832201.938373:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202633216 00010000:00010000:0.0:1788832201.938416:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000098ff7157/0x998c12b2835378ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047fa expref: 11 pid: 8442 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832201.938457:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00100000:0.0:1788832201.938468:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+11:2394:x1875726202633216:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832201.938495:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832201.938522:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000098ff7157/0x998c12b2835378ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047fa expref: 11 pid: 8442 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.938560:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000098ff7157/0x998c12b2835378ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047fa expref: 11 pid: 8442 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.938589:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098ff7157/0x998c12b2835378ed lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047fa expref: 11 pid: 8442 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.938606:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832201.938611:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832201.938676:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b2835378f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04801 expref: 10 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.938690:0:10343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b2835378f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04801 expref: 10 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.938740:0:10343:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b2835378f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04801 expref: 10 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832201.938766:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fde0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10343:1875726218425728:192.168.203.26@tcp:105: 00000100:00100000:0.0:1788832201.939275:0:10343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832201.943905:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788832201.943937:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fde0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218425856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788832201.944032:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832201.944146:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218425856 00000100:00100000:3.0:1788832201.944157:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218425856 00000100:00100000:3.0:1788832201.944227:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788832201.944237:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218425856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788832201.944392:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788832201.944602:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218425856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 364us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832201.944610:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788832201.944892:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fde0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218425856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788832201.948017:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fde0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10343:1875726218425728:192.168.203.26@tcp:105: 00010000:00010000:0.0:1788832201.948053:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832201.948187:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+10:2394:x1875726202633216:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 9719us (10078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832201.948201:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00100000:2.0:1788832201.954074:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832201.955428:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202633344 00000100:00100000:1.0:1788832201.955446:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202633344 00002000:00100000:1.0:1788832201.955599:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9d2b07754e00 x1875726202633344/t0(0) o4->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:142/0 lens 504/0 e 0 to 0 dl 1788832212 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788832201.955612:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2b07754e00 with x1875726202633344 ext(0->12) 00002000:00010000:1.0:1788832201.955802:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d2b07754e00 00000100:00100000:1.0:1788832201.955847:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:1.0:1788832201.955860:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:352fff76-09db-42cd-818a-16e788a01abb+10:2394:x1875726202633344:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788832201.960204:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:352fff76-09db-42cd-818a-16e788a01abb+12:2394:x1875726202633344:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 Request processed in 4331us (6127us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788832201.960239:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 3 00002000:00100000:1.0:1788832201.960256:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9d2b07754e00 x1875726202633344/t4294967310(0) o4->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:142/0 lens 504/448 e 0 to 0 dl 1788832212 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788832201.960268:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2b07754e00 with x1875726202633344 ext(0->12) 00002000:00010000:1.0:1788832201.960276:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d2b07754e00 00000100:00100000:2.0:1788832201.963247:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832201.963421:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202633472 00000100:00100000:1.0:1788832201.963440:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202633472 00000100:00100000:1.0:1788832201.963534:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 136 00000100:00100000:1.0:1788832201.963547:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+68:11401:x1875726202633472:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788832201.969013:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1788832201.969030:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:3.0:1788832201.969069:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788832201.969086:0:6504:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d2b073b70c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788832201.969090:0:6504:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d2c3fc0e300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d2b073b7180 00000020:00080000:3.0:1788832201.969094:0:6504:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d2c3fc0eb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d2b066e3600 00000004:00080000:3.0:1788832201.969121:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788832201.969150:0:6504:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d2c050f5d80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788832201.969152:0:6504:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d2b07cfb300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d2c050f5480 00000020:00080000:3.0:1788832201.969168:0:6504:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d2b07cfb100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d2b07240800 00000020:00080000:3.0:1788832201.969194:0:6557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788832201.969246:0:6557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:0.0:1788832201.969472:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b2835375f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969615:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b2835375f9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832201.969664:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07dddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218425984:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788832201.969669:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b2835375f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969678:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0ce00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832201.969686:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b2835375f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969696:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b2835375f9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969730:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d2b073ae900) 00000100:00100000:1.0:1788832201.969739:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832201.969752:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832201.969762:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b2835375f9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969770:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b2835375f9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969815:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b2835376a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969821:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b2835376a1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969827:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b2835376a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969850:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0ca00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832201.969854:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b2835376a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969860:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b2835376a1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969869:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d2c39194d00) 00010000:00010000:0.0:1788832201.969872:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832201.969875:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b2835376a1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969886:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b2835376a1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969906:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b28353771f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969913:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b28353771f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969919:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b28353771f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969925:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dda00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832201.969928:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b28353771f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969935:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b28353771f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969954:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2c0ad05000) 00010000:00010000:0.0:1788832201.969957:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832201.969960:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b28353771f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969967:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b28353771f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969982:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537742 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969989:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537742 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.969996:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537742 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.970002:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc600 already unused, calling callback (ffffffffc1a1f4f0) 00000100:00100000:1.0:1788832201.970005:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218425984 00010000:00010000:0.0:1788832201.970006:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537742 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832201.970015:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218425984 00010000:00010000:0.0:1788832201.970018:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537742 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.970029:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2c0ad05000) 00010000:00010000:0.0:1788832201.970032:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832201.970035:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537742 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.970040:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537742 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.970066:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537814 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.970073:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537814 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832201.970082:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00010000:00010000:0.0:1788832201.970090:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537814 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.970099:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031c00 already unused, calling callback (ffffffffc1a1f4f0) 00000100:00100000:1.0:1788832201.970100:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1875726218425984:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788832201.970109:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537814 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.970120:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537814 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.970130:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:0.0:1788832201.970133:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00080000:1.0:1788832201.970137:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:0.0:1788832201.970138:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537814 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.970150:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537814 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.970172:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788832201.970175:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f69c8, atime: 0x6a9f69c8, ctime: 0x6a9f69c8, blocks: 0x8 00010000:00010000:0.0:1788832201.970187:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832201.970193:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d82f700/0x998c12b2835378fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.970197:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.970219:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0dc00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832201.970223:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=342s v=(0 0) 00010000:00010000:0.0:1788832201.970223:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832201.970239:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832201.970242:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832201.970250:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d82f700/0x998c12b2835378fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832201.971046:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d82f700/0x998c12b2835378fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832201.971059:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d82f700/0x998c12b2835378fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832201.971067:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d82f700/0x998c12b2835378fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832201.971097:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788832201.971252:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3651:x1875726218425984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1155us (1518us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788832201.971260:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:1.0:1788832201.971322:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d2b07dddf80/2, rc 0, transno 4294967305 00000100:00100000:1.0:1788832201.971328:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07dddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218425984:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788832201.971501:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+17:11401:x1875726202633472:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 Request processed in 7955us (8260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832201.971508:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 136 00000100:00100000:2.0:1788832201.971785:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788832201.971808:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218426240:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788832201.971879:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832201.971936:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218426240 00000100:00100000:2.0:1788832201.971943:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218426240 00000100:00100000:2.0:1788832201.972004:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788832201.972014:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218426240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788832201.972168:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788832201.972172:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788832202 00002000:00010000:2.0:1788832201.972187:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788832201.972190:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788832202 -> 1788832202 00002000:00010000:2.0:1788832201.972193:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788832201.972234:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3654:x1875726218426240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 221us (355us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788832201.972242:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788832201.972264:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832201.972296:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1788832201.972303:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1788832201.972335:0:3654:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9d2b07754700 x1875726218426240/t4294967311(4294967311) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788832217 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788832201.972347:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d2b07754700/2, rc 0, transno 4294967311 00000100:00100000:2.0:1788832201.972351:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07754700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218426240:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788832201.972364:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832201.972372:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218426112:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788832201.972400:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788832201.973005:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:0.0:1788832201.973008:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788832201.973017:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378d1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.973024:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b2835378d1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832201.973058:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218426112 00010000:00010000:3.0:1788832201.973448:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832201.973464:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d82f700/0x998c12b2835378fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.973478:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff000 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:3.0:1788832201.973482:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d82f700/0x998c12b2835378fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.973493:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d82f700/0x998c12b2835378fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.973514:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d82f700/0x998c12b2835378fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.973522:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d82f700/0x998c12b2835378fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.973555:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832201.973557:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832201.973559:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832201.975149:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218426112 00000100:00100000:0.0:1788832201.975261:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788832201.975275:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3651:x1875726218426112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788832201.975317:0:8441:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:0.0:1788832201.975350:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ccf0c40/0x998c12b283537902 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.975382:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000daef9094/0x998c12b2835376af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04759 expref: 11 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.975392:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1788832201.975398:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788832201.975422:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ccf0c40/0x998c12b283537902 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.975467:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000daef9094/0x998c12b2835376af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04759 expref: 11 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.975485:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000daef9094/0x998c12b2835376af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04759 expref: 11 pid: 8441 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832201.975504:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fde0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8441:1875726218426368:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788832201.977220:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832201.984703:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832201.984766:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fde0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8441:1875726218426368:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788832201.984792:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202633600 00010000:00010000:0.0:1788832201.984811:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003ccf0c40/0x998c12b283537902 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832201.984819:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202633600 00010000:00010000:3.0:1788832201.984878:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000daef9094/0x998c12b2835376af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04759 expref: 12 pid: 8441 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832201.984957:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:3.0:1788832201.984970:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c0947b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+12:2393:x1875726202633600:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832201.984987:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832201.984994:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000daef9094/0x998c12b2835376af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04759 expref: 12 pid: 8441 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.985015:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000daef9094/0x998c12b2835376af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04759 expref: 12 pid: 8441 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.985044:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000daef9094/0x998c12b2835376af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04759 expref: 12 pid: 8441 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.985062:0:10344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788832201.985067:0:10344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788832201.985073:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003ccf0c40/0x998c12b283537902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.985091:0:10344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ccf0c40/0x998c12b283537902 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832201.985127:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788832201.985197:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003ccf0c40/0x998c12b283537902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.985217:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ccf0c40/0x998c12b283537902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832201.985218:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c0947b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+11:2393:x1875726202633600:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 240us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832201.985249:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 72 00010000:00010000:0.0:1788832201.985253:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ccf0c40/0x998c12b283537902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.985270:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ccf0c40/0x998c12b283537902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832201.985316:0:8441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788832201.985597:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3651:x1875726218426112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10321us (13192us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788832201.985608:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:1.0:1788832201.985703:0:13191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832201.985713:0:13191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ccf0c40/0x998c12b283537902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832201.985723:0:13191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0d800 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:1.0:1788832201.985728:0:13191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ccf0c40/0x998c12b283537902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832201.985762:0:13191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ccf0c40/0x998c12b283537902 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832201.985776:0:13191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ccf0c40/0x998c12b283537902 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832201.985784:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ccf0c40/0x998c12b283537902 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832201.985811:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832201.985813:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832201.985816:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788832201.986993:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d2b07756300/2, rc 0, transno 4294967312 00000100:00100000:3.0:1788832201.987006:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07756300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218426112:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788832201.990384:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832201.996521:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202633728 00000100:00100000:1.0:1788832201.996548:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202633728 00000100:00100000:1.0:1788832201.996602:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:1.0:1788832201.996612:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+11:2393:x1875726202633728:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788832201.998554:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1788832201.998571:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:1.0:1788832201.998832:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202633728:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 Request processed in 2215us (8451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832201.998843:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:1.0:1788832202.002700:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832202.003075:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202633984 00000100:00100000:3.0:1788832202.003089:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202633984 00000100:00100000:3.0:1788832202.003165:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 137 00000100:00100000:3.0:1788832202.003179:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+16:11401:x1875726202633984:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788832202.003254:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832202.003291:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b2835378e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047f3 expref: 16 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.003314:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:3.0:1788832202.003320:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788832202.003372:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537909 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.003389:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537909 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.003401:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537909 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788832202.003570:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000300e7b0 reply state 000000006299d8bf transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537909 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.003585:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537909 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.003616:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:3.0:1788832202.003669:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788832202.003673:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788832202.003852:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+17:11401:x1875726202633984:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 674us (1163us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1788832202.003862:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 137 00000100:00100000:2.0:1788832202.009439:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832202.009579:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202634112 00000100:00100000:1.0:1788832202.009596:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202634112 00000100:00100000:1.0:1788832202.009796:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:1.0:1788832202.009811:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+6:2394:x1875726202634112:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788832202.010044:0:10097:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788832202.010087:0:10097:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788832202 -> 1788832201 00002000:00010000:1.0:1788832202.010090:0:10097:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788832200 00002000:00010000:1.0:1788832202.010093:0:10097:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788832202 -> 1788832201 00002000:00010000:1.0:1788832202.010096:0:10097:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788832202.010191:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+7:2394:x1875726202634112:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 384us (771us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788832202.010199:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:1.0:1788832202.025905:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832202.025998:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202634368 00000100:00100000:3.0:1788832202.026012:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202634368 00000100:00100000:3.0:1788832202.026095:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 138 00000100:00100000:3.0:1788832202.026110:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+17:11401:x1875726202634368:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788832202.026217:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537910 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.026239:0:13811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835378ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047e5 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.026251:0:13811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537910 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.026295:0:13811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835378ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047e5 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.026311:0:13811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835378ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047e5 expref: 17 pid: 6525 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832202.026329:0:13811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13811:1875726218426496:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788832202.026464:0:13811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f5480 going to sleep for 11 seconds 00000100:00100000:2.0:1788832202.031494:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832202.032114:0:13811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13811:1875726218426496:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788832202.032153:0:13811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537910 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832202.035243:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202634496 00000100:00100000:0.0:1788832202.035259:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202634496 00010000:00010000:0.0:1788832202.035336:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835378ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047e5 expref: 18 pid: 6525 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832202.035377:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 73 00000100:00100000:0.0:1788832202.035388:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+18:2394:x1875726202634496:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832202.035403:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832202.035410:0:7466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835378ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047e5 expref: 18 pid: 6525 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.035434:0:7466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835378ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047e5 expref: 18 pid: 6525 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.035463:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835378ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047e5 expref: 18 pid: 6525 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.035483:0:7466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:0.0:1788832202.035489:0:7466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537910 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.035499:0:7466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537910 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.035523:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537910 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.035558:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832202.035953:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07755f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+17:2394:x1875726202634496:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 564us (4537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832202.035963:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 73 00010000:00010000:3.0:1788832202.036182:0:13811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537910 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.036199:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537910 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.036256:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537910 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.036264:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537910 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.036272:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537910 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.036279:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092ddc00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832202.036284:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537910 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.036292:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537910 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.036309:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:3.0:1788832202.036312:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788832202.036317:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537910 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.036326:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537910 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832202.036445:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+16:11401:x1875726202634368:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 Request processed in 10334us (10551us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788832202.036455:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 138 00000100:00100000:2.0:1788832202.042538:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832202.042735:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202634624 00000100:00100000:0.0:1788832202.042752:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202634624 00000100:00100000:0.0:1788832202.042804:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:0.0:1788832202.042813:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+7:2393:x1875726202634624:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788832202.042856:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006345417c/0x998c12b283537917 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.042875:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b2835378f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04801 expref: 7 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.042884:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788832202.042888:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788832202.042893:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006345417c/0x998c12b283537917 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.042924:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b2835378f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04801 expref: 7 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.042938:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b2835378f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04801 expref: 7 pid: 10097 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832202.042965:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fde0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8441:1875726218426624:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788832202.043038:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fb600 going to sleep for 11 seconds 00000100:00100000:0.0:1788832202.049909:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fde0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8441:1875726218426624:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788832202.049944:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006345417c/0x998c12b283537917 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832202.052838:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832202.054182:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202634752 00000100:00100000:1.0:1788832202.054200:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202634752 00010000:00010000:1.0:1788832202.054263:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b2835378f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04801 expref: 8 pid: 10097 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832202.054327:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 74 00000100:00100000:1.0:1788832202.054339:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07756d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:352fff76-09db-42cd-818a-16e788a01abb+8:2393:x1875726202634752:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832202.054933:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832202.054968:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b2835378f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04801 expref: 8 pid: 10097 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.054986:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b2835378f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04801 expref: 8 pid: 10097 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.055017:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b2835378f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04801 expref: 8 pid: 10097 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.055042:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788832202.055067:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788832202.055076:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006345417c/0x998c12b283537917 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.055086:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006345417c/0x998c12b283537917 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.055127:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788832202.055561:0:8441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006345417c/0x998c12b283537917 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.055583:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006345417c/0x998c12b283537917 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.055658:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006345417c/0x998c12b283537917 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.055669:0:8441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006345417c/0x998c12b283537917 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.055678:0:8441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006345417c/0x998c12b283537917 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.055686:0:8441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0dc00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:0.0:1788832202.055692:0:8441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006345417c/0x998c12b283537917 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.055724:0:8441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006345417c/0x998c12b283537917 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.055754:0:8441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006345417c/0x998c12b283537917 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.055763:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006345417c/0x998c12b283537917 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832202.055804:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07756d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:352fff76-09db-42cd-818a-16e788a01abb+7:2393:x1875726202634752:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 1459us (3208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832202.055818:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 74 00000100:00100000:0.0:1788832202.055877:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202634624:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 Request processed in 13057us (13340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832202.055888:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:2.0:1788832202.058479:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832202.061021:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202635008 00000100:00100000:1.0:1788832202.061043:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202635008 00000100:00100000:1.0:1788832202.061381:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 139 00000100:00100000:1.0:1788832202.061396:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+16:11401:x1875726202635008:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788832202.061959:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b28353791e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.061982:0:8742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b28353780d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047ad expref: 16 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.061992:0:8742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b28353791e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.062038:0:8742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b28353780d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047ad expref: 16 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.062056:0:8742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b28353780d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047ad expref: 16 pid: 8742 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832202.062091:0:8742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ddc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8742:1875726218426752:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788832202.062218:0:8742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c404b0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788832202.066804:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832202.066896:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202635136 00000100:00100000:3.0:1788832202.066909:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202635136 00010000:00010000:3.0:1788832202.066959:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b28353780d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047ad expref: 17 pid: 8742 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832202.067008:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75 00000100:00100000:3.0:1788832202.067018:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+17:2394:x1875726202635136:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832202.067038:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832202.067047:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b28353780d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047ad expref: 17 pid: 8742 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.067065:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b28353780d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047ad expref: 17 pid: 8742 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.067106:0:10344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:3.0:1788832202.067114:0:10344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b28353786f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047d0 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.067126:0:10344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b28353791e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.067136:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b28353791e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.067168:0:10344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b28353791e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.067193:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832202.067270:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+17:2394:x1875726202635136:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 252us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832202.067279:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75 00010000:00010000:2.0:1788832202.068067:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b28353780d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047ad expref: 16 pid: 8742 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832202.068091:0:8742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ddc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8742:1875726218426752:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832202.068119:0:8742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b28353791e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.068140:0:8742:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b28353791e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.068147:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b28353791e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.071379:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537925 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.071414:0:8742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378d8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047ec expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.071424:0:8742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537925 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.071593:0:8742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047ec expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.071610:0:8742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047ec expref: 16 pid: 6526 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832202.071644:0:8742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07754380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8742:1875726218426880:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788832202.071938:0:8742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376000 going to sleep for 11 seconds 00000100:00100000:1.0:1788832202.076816:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832202.076894:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202635264 00000100:00100000:3.0:1788832202.076907:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202635264 00010000:00010000:3.0:1788832202.076962:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378d8 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047ec expref: 17 pid: 6526 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832202.077017:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 76 00000100:00100000:3.0:1788832202.077029:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+17:2394:x1875726202635264:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832202.077049:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832202.077057:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378d8 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047ec expref: 17 pid: 6526 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.077072:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047ec expref: 17 pid: 6526 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.077102:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:3.0:1788832202.077109:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537925 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.077120:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537925 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.077153:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537925 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.077185:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788832202.077327:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b2835378d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047ec expref: 17 pid: 6526 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832202.077357:0:8742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07754380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8742:1875726218426880:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832202.077384:0:8742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537925 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.077402:0:8742:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537925 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.077408:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537925 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788832202.077556:0:8742:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1788832202.077770:0:8742:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1788832202.077813:0:8742:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1788832202.077906:0:8742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07754380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8742:1875726218427008:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788832202.080036:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+19:2394:x1875726202635264:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 2992us (3226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832202.080053:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 76 00000100:00100000:2.0:1788832202.080240:0:8742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832202.080285:0:8742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376900 going to sleep for 11 seconds 00000100:00100000:3.0:1788832202.080586:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218427008 00000100:00100000:3.0:1788832202.080598:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218427008 00000100:00100000:3.0:1788832202.080690:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788832202.080702:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8742:x1875726218427008:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788832202.080854:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8742:x1875726218427008:12345-0@lo:1000:mdt00_003.0 Request processed in 155us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832202.080862:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788832202.081121:0:8742:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788832202.081129:0:8742:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d2b07754700, transno 4294967311 00000004:00080000:1.0:1788832202.081144:0:8742:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d2b07756300, transno 4294967312 00000100:00100000:1.0:1788832202.081151:0:8742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07754380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8742:1875726218427008:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788832202.081608:0:8742:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1788832202.083401:0:8742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ddf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8742:1875726218427136:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788832202.083496:0:8742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832202.083533:0:8742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3d711600 going to sleep for 11 seconds 00000100:00100000:3.0:1788832202.084528:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218427136 00000100:00100000:3.0:1788832202.084541:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218427136 00000100:00100000:3.0:1788832202.084614:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788832202.084649:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8742:x1875726218427136:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788832202.085583:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8742:x1875726218427136:12345-0@lo:1000:mdt00_003.0 Request processed in 933us (2081us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788832202.085595:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788832202.085821:0:8742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ddf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8742:1875726218427136:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788832202.085983:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537925 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.086044:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537925 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.086054:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537925 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.086060:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832202.086066:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537925 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.086075:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537925 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.086187:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:1.0:1788832202.086192:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788832202.086198:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537925 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.086206:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283537925 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.086245:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537868 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.086253:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537868 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.086260:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537868 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.086266:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832202.086269:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537868 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.086275:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537868 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.086284:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:1.0:1788832202.086287:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788832202.086296:0:8742:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b28353786f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047d0 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.086309:0:8742:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b28353786f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047d0 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.086328:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b28353786f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047d0 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.087021:0:8742:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b28353786f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047d0 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832202.087053:0:8742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ddd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8742:1875726218427264:192.168.203.26@tcp:105: 00000100:00100000:1.0:1788832202.087555:0:8742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c1b00b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832202.094720:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832202.094976:0:8742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ddd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8742:1875726218427264:192.168.203.26@tcp:105: 00010000:00010000:1.0:1788832202.095021:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537868 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.095036:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b283537868 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.095079:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353792c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.095096:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353792c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.095112:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353792c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.095135:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353792c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.095141:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353792c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.095166:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353792c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.095172:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfee00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832202.095176:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353792c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.095184:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353792c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.095199:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:1.0:1788832202.095202:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832202.095206:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353792c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.095212:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b28353792c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.095224:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b28353791e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.095230:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b28353791e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.095236:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b28353791e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.095242:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832202.095244:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b28353791e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.095260:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b28353791e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.095269:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:1.0:1788832202.095272:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788832202.095274:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b28353791e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.095280:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b28353791e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832202.095698:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+19:11401:x1875726202635008:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 34302us (37236us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788832202.095711:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 139 00000020:00080000:1.0:1788832202.095718:0:8742:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788832202.096386:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202635392 00000100:00100000:3.0:1788832202.096400:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202635392 00000100:00100000:3.0:1788832202.096526:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:3.0:1788832202.096538:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+19:11400:x1875726202635392:12345-192.168.203.26@tcp:49:lfs.0 00000100:00100000:3.0:1788832202.096704:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+19:11400:x1875726202635392:12345-192.168.203.26@tcp:49:lfs.0 Request processed in 167us (1998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832202.096712:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 31 00000040:00080000:0.0:1788832202.100790:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832202.100802:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832202.101294:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788832202.101308:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788832202.103546:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832202.103735:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832202.103836:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202635904 00000100:00100000:3.0:1788832202.103866:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202635904 00000100:00100000:3.0:1788832202.103930:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 32 00000100:00100000:3.0:1788832202.103941:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18f2ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+19:11401:x1875726202635904:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788832202.104302:0:6528:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788832202.104345:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1788832202.104380:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537933 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.104400:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537933 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.104413:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537933 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.104422:0:6528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537933 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.104429:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537933 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.104435:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537933 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.104465:0:6528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788832202.104572:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18f2ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+21:11401:x1875726202635904:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 631us (834us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788832202.104580:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 32 00000020:00080000:3.0:1788832202.104586:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788832202.105468:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832202.105481:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537933 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.105492:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092ddc00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:1.0:1788832202.105496:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537933 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.105506:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537933 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.105523:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:1.0:1788832202.105527:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788832202.105532:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537933 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.105559:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537933 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6528 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832202.105576:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832202.105578:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832202.105579:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832202.109236:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202635648 00000100:00100000:0.0:1788832202.109258:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202635648 00000100:00100000:0.0:1788832202.109373:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 140 00000100:00100000:0.0:1788832202.109387:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+21:11400:x1875726202635648:12345-192.168.203.26@tcp:58:lfs.0 00000040:00080000:0.0:1788832202.109815:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788832202.109959:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+21:11400:x1875726202635648:12345-192.168.203.26@tcp:58:lfs.0 Request processed in 574us (6424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832202.109969:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 140 00000100:00100000:2.0:1788832202.153417:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832202.153512:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202636032 00000100:00100000:3.0:1788832202.153527:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202636032 00000100:00100000:3.0:1788832202.153615:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 141 00000100:00100000:3.0:1788832202.153696:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+21:11403:x1875726202636032:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788832202.153732:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832202.153772:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b28353793a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04808 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.153855:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537941 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.153875:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537941 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.153890:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537941 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.153909:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537948 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.153915:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537948 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.153922:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537948 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.154095:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353794f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.154107:0:13811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353785a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047c9 expref: 22 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832202.154116:0:13811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353794f lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.154507:0:13811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353785a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047c9 expref: 22 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.154525:0:13811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353785a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047c9 expref: 22 pid: 8742 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832202.154542:0:13811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07754380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13811:1875726218427392:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788832202.154902:0:13811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832202.163157:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832202.164023:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202636288 00000100:00100000:1.0:1788832202.164038:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202636288 00000100:00100000:1.0:1788832202.164124:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:1.0:1788832202.164137:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+23:6637:x1875726202636288:12345-192.168.203.26@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788832202.164362:0:13811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07754380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13811:1875726218427392:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832202.164402:0:13811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353794f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832202.164910:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+24:6637:x1875726202636288:12345-192.168.203.26@tcp:35:ldlm_bl.0 Request processed in 773us (1765us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788832202.164920:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:1.0:1788832202.171534:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832202.173017:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202636416 00000100:00100000:0.0:1788832202.173041:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202636416 00010000:00010000:0.0:1788832202.173125:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353785a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047c9 expref: 24 pid: 8742 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832202.173185:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 77 00000100:00100000:0.0:1788832202.173198:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+24:2394:x1875726202636416:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832202.173219:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832202.173227:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353785a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047c9 expref: 24 pid: 8742 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.173254:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353785a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047c9 expref: 24 pid: 8742 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.173285:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b28353785a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047c9 expref: 24 pid: 8742 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.173309:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:0.0:1788832202.173316:0:10343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353794f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.173327:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353794f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.173336:0:10343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353794f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832202.173392:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832202.173484:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+23:2394:x1875726202636416:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 288us (2251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832202.173493:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 77 00010000:00010000:2.0:1788832202.173975:0:13811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353794f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.173987:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353794f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832202.174069:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788832202.174074:0:13811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788832202.174104:0:13811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353794f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.174121:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353794f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.174132:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537941 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.174139:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537941 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.174147:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537941 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.174153:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832202.174158:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537941 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.174167:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537941 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.174180:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:2.0:1788832202.174196:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832202.174201:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537941 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.174209:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537941 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.174227:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537948 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.174234:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537948 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.174251:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537948 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.174256:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092ddc00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832202.174259:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537948 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.174266:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537948 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.174274:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d2c03837400) 00010000:00010000:2.0:1788832202.174277:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832202.174280:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537948 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.174286:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537948 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.174337:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b28353793a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04808 expref: 23 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.174366:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353794f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04808 expref: 22 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832202.174375:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:2.0:1788832202.174377:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832202.174380:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dc200, rc 0) 00000100:00100000:2.0:1788832202.174442:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+22:11403:x1875726202636032:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 20751us (21040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832202.174450:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 141 00010000:00010000:3.0:1788832202.199929:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832202.454915:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218427776:0@lo:400:kworker.0 00000100:00100000:3.0:1788832202.454984:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832202.455045:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1875726218428288:0@lo:400:kworker.0 00000100:00100000:3.0:1788832202.455071:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832202.455092:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fda8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218428800:0@lo:400:kworker.0 00000100:00100000:3.0:1788832202.455115:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832202.455139:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788832202.455145:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875726218427648:0@lo:400:kworker.0 00000100:00100000:3.0:1788832202.455166:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832202.455183:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1875726218428160:0@lo:400:kworker.0 00000100:00100000:3.0:1788832202.455223:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832202.455241:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fda8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218428672:0@lo:400:kworker.0 00000100:00100000:3.0:1788832202.455263:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832202.455297:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218427776 00000100:00100000:3.0:1788832202.455316:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218427776 00000100:00100000:3.0:1788832202.455365:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788832202.455375:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fda9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218427776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832202.455441:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fda9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218427776:12345-0@lo:400:kworker.0 Request processed in 68us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832202.455448:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788832202.455473:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218428800 00000100:00100000:3.0:1788832202.455477:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218428800 00000100:00100000:3.0:1788832202.455515:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788832202.455528:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36c88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218428800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832202.455653:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218427904:0@lo:400:kworker.0 00000100:00100000:1.0:1788832202.455684:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832202.455704:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fdaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218428416:0@lo:400:kworker.0 00000100:00100000:1.0:1788832202.455725:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832202.455753:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788832202.455759:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218427520:0@lo:400:kworker.0 00000100:00100000:1.0:1788832202.455787:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832202.455809:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218428032:0@lo:400:kworker.0 00000100:00100000:1.0:1788832202.455841:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832202.455860:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fda9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218428544:0@lo:400:kworker.0 00000100:00100000:1.0:1788832202.455881:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832202.455909:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218428288 00000100:00100000:1.0:1788832202.455913:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218428288 00000100:00100000:1.0:1788832202.455936:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218427648 00000100:00100000:1.0:1788832202.455940:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218427648 00000100:00100000:1.0:1788832202.455952:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218428160 00000100:00100000:1.0:1788832202.455954:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218428160 00000100:00100000:1.0:1788832202.455966:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218428672 00000100:00100000:1.0:1788832202.455968:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218428672 00000100:00100000:1.0:1788832202.455978:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218427904 00000100:00100000:1.0:1788832202.455980:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218427904 00000100:00100000:1.0:1788832202.455988:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218428544 00000100:00100000:1.0:1788832202.455990:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218428544 00000100:00100000:1.0:1788832202.456001:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788832202.456007:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875726218428288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832202.456038:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875726218428288:12345-0@lo:400:kworker.0 Request processed in 32us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832202.456044:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788832202.456057:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788832202.456062:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875726218427648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832202.456086:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875726218427648:12345-0@lo:400:kworker.0 Request processed in 24us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832202.456091:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788832202.456101:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788832202.456106:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875726218428160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832202.456127:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875726218428160:12345-0@lo:400:kworker.0 Request processed in 22us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832202.456133:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788832202.456141:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788832202.456146:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875726218428672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832202.456175:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875726218428672:12345-0@lo:400:kworker.0 Request processed in 29us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832202.456181:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788832202.456190:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788832202.456195:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218427904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832202.456219:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218427904:12345-0@lo:400:kworker.0 Request processed in 24us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832202.456225:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788832202.456235:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788832202.456240:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218428544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832202.456259:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218428544:12345-0@lo:400:kworker.0 Request processed in 20us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832202.456264:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788832202.456284:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218428416 00000100:00100000:1.0:1788832202.456287:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218428416 00000100:00100000:1.0:1788832202.456311:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788832202.456318:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218428416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832202.456345:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218428416:12345-0@lo:400:kworker.0 Request processed in 28us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832202.456351:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788832202.456388:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fda9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218428544:0@lo:400:kworker.0 00000100:00100000:1.0:1788832202.456398:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218427904:0@lo:400:kworker.0 00000100:00100000:1.0:1788832202.456406:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fdaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218428416:0@lo:400:kworker.0 00000100:00100000:1.0:1788832202.456450:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218428032 00000100:00100000:1.0:1788832202.456458:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218428032 00000100:00100000:1.0:1788832202.456478:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788832202.456484:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218428032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832202.456514:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218428032:12345-0@lo:400:kworker.0 Request processed in 30us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832202.456519:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788832202.456651:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218428032:0@lo:400:kworker.0 00000100:00100000:1.0:1788832202.456678:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875726218427648:0@lo:400:kworker.0 00000100:00100000:1.0:1788832202.456688:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1875726218428160:0@lo:400:kworker.0 00010000:00080000:1.0:1788832202.456699:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fda8000 x1875726218428672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832202.456710:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fda8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218428672:0@lo:400:kworker.0 00000100:00100000:1.0:1788832202.456719:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218427776:0@lo:400:kworker.0 00010000:00080000:1.0:1788832202.456728:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b077a6a00 x1875726218428288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832202.456736:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1875726218428288:0@lo:400:kworker.0 00000100:00080000:1.0:1788832202.456783:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788832202.456788:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788832202.456790:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788832202.456792:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788832202.456807:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218427520 00000100:00100000:1.0:1788832202.456810:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218427520 00000100:00100000:1.0:1788832202.456836:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788832202.456842:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3653:x1875726218427520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832202.456890:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3653:x1875726218427520:12345-0@lo:400:kworker.0 Request processed in 48us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832202.456896:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788832202.456926:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218427520:0@lo:400:kworker.0 00000100:00100000:0.0:1788832202.460788:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218428928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832202.460853:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832202.461041:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218428928 00000100:00100000:1.0:1788832202.461048:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218428928 00000100:00100000:1.0:1788832202.461118:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788832202.461128:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1875726218428928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788832202.461156:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788832202.461198:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1875726218428928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832202.461205:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1788832202.461614:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788832202.461692:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218428928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832202.463827:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36c88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218428800:12345-0@lo:400:kworker.0 Request processed in 8293us (8705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832202.463839:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788832202.464228:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fda8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218428800:0@lo:400:kworker.0 00000040:00080000:2.0:1788832202.960865:0:14314:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788832202.960874:0:14314:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788832202.960903:0:14314:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788832202.960909:0:14314:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788832202.973903:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218429056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788832202.973971:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832202.974037:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218429056 00000100:00100000:3.0:1788832202.974044:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218429056 00000100:00100000:3.0:1788832202.974087:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788832202.974095:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218429056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788832202.974118:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788832202.974160:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218429056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832202.974166:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788832202.974209:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07df4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218429056:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1788832203.159073:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832203.159082:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832203.159104:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788832203.159109:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788832203.159242:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fde0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875726218429184:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788832203.159369:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788832203.165829:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fde0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875726218429184:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788832203.170516:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832203.170679:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202636544 00000100:00100000:1.0:1788832203.170689:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202636544 00000100:00100000:1.0:1788832203.170785:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 142 00000100:00100000:1.0:1788832203.170797:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+22:11415:x1875726202636544:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788832203.170834:0:8742:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:2.0:1788832203.171274:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832203.171365:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+22:11415:x1875726202636544:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 567us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832203.171374:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 142 00000100:00100000:1.0:1788832203.175309:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832203.175471:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202636800 00000100:00100000:2.0:1788832203.175482:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202636800 00000100:00100000:2.0:1788832203.175685:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 143 00000100:00100000:2.0:1788832203.175696:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+22:11415:x1875726202636800:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788832203.175717:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832203.175749:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537956 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0480f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832203.175984:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d400/0x998c12b28353795d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832203.176003:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d400/0x998c12b28353795d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832203.176017:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d400/0x998c12b28353795d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832203.176028:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788832203.176244:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537956 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0480f expref: 25 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832203.177299:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d400/0x998c12b28353795d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0480f expref: 24 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832203.177317:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:0.0:1788832203.177321:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788832203.177325:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0d400, rc 0) 00000100:00100000:0.0:1788832203.177472:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+24:11415:x1875726202636800:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 1775us (2170us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788832203.177491:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 143 00000100:00100000:2.0:1788832203.183721:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832203.183812:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202637056 00000100:00100000:0.0:1788832203.183822:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202637056 00000100:00100000:0.0:1788832203.183880:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 144 00000100:00100000:0.0:1788832203.183888:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+24:11415:x1875726202637056:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788832203.183967:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353796b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832203.183984:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353796b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832203.183995:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353796b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832203.184131:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353796b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832203.184138:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353796b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832203.184161:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353796b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832203.184166:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832203.184171:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353796b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832203.184179:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353796b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832203.184191:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:0.0:1788832203.184193:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788832203.184198:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353796b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832203.184204:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b28353796b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832203.184317:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+25:11415:x1875726202637056:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 428us (606us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788832203.184325:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 144 00000100:00100000:3.0:1788832203.185834:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832203.185960:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202637184 00000100:00100000:0.0:1788832203.185970:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202637184 00000100:00100000:0.0:1788832203.186030:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:0.0:1788832203.186038:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+25:2393:x1875726202637184:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832203.186052:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832203.186075:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d400/0x998c12b28353795d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0480f expref: 25 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832203.186111:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:0.0:1788832203.186115:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832203.186158:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+24:2393:x1875726202637184:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 121us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832203.186165:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:2.0:1788832203.187960:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832203.188115:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202637440 00000100:00100000:3.0:1788832203.188124:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202637440 00000100:00100000:3.0:1788832203.188182:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:3.0:1788832203.188193:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+24:11415:x1875726202637440:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788832203.188447:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+25:11415:x1875726202637440:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 255us (496us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788832203.188995:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 34 00000040:00080000:1.0:1788832203.189421:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788832203.189427:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788832203.190020:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788832203.190038:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788832203.225373:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832203.479765:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218429312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788832203.479859:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832203.479983:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218429312 00000100:00100000:3.0:1788832203.480011:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218429312 00000100:00100000:3.0:1788832203.480086:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788832203.480095:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218429312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788832203.480125:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788832203.482366:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218429312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2262us (2497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832203.482388:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788832203.482672:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218429312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788832203.991036:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788832203.991059:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218429440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788832203.991125:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832203.991232:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218429440 00000100:00100000:3.0:1788832203.991239:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218429440 00000100:00100000:3.0:1788832203.991297:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788832203.991306:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875726218429440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788832203.991326:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788832203.991370:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875726218429440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832203.991376:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788832203.991419:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07df7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218429440:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788832203.991557:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788832204.247302:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832204.501030:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832204.501092:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832204.501119:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832204.501198:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832204.501222:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832204.501261:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202637952 00000100:00100000:0.0:1788832204.501272:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202637952 00000100:00100000:0.0:1788832204.501346:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 108 00000100:00100000:0.0:1788832204.501357:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202637952:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832204.501439:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202637952:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 83us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832204.501458:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 108 00000100:00080000:0.0:1788832204.502494:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832204.507912:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832204.507985:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832204.508732:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202637696 00000100:00100000:3.0:1788832204.508743:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202637696 00000100:00100000:3.0:1788832204.508806:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202638208 00000100:00100000:3.0:1788832204.508809:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202638208 00000100:00100000:3.0:1788832204.508836:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202637824 00000100:00100000:3.0:1788832204.508841:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202637824 00000100:00100000:3.0:1788832204.508861:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 279 00000100:00100000:3.0:1788832204.508871:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+25:2393:x1875726202637696:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832204.508971:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+25:2393:x1875726202637696:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 90us (7938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832204.508980:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 279 00000100:00100000:3.0:1788832204.509014:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 280 00000100:00100000:3.0:1788832204.509020:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202638208:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832204.509048:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202638208:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 29us (7929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832204.509053:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 280 00000100:00100000:3.0:1788832204.509064:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 281 00000100:00100000:3.0:1788832204.509070:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202637824:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832204.509092:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202637824:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 23us (7870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832204.509098:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 281 00000100:00080000:3.0:1788832204.509128:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788832204.509132:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832204.510083:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202637568 00000100:00100000:2.0:1788832204.510092:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202637568 00000100:00100000:2.0:1788832204.510135:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 379 00000100:00100000:2.0:1788832204.510144:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2393:x1875726202637568:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832204.510190:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2393:x1875726202637568:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 48us (8991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832204.510197:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 379 00000100:00100000:3.0:1788832204.510850:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202638336 00000100:00100000:3.0:1788832204.510856:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202638336 00000100:00100000:3.0:1788832204.510916:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 282 00000100:00100000:3.0:1788832204.510923:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202638336:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832204.510970:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202638336:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 48us (2986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832204.510977:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 282 00000100:00080000:2.0:1788832204.513849:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788832204.514370:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202638080 00000100:00100000:2.0:1788832204.514380:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202638080 00000100:00100000:2.0:1788832204.514452:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 109 00000100:00100000:2.0:1788832204.514463:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c182ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202638080:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832204.514551:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c182ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202638080:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 90us (6647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832204.514558:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 109 00000100:00080000:0.0:1788832204.514889:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1788832204.711020:0:14367:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832204.711030:0:14367:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832204.711062:0:14367:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788832204.711068:0:14367:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788832204.902967:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832204.903031:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202638592 00000100:00100000:3.0:1788832204.903040:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202638592 00000100:00100000:3.0:1788832204.903098:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 145 00000100:00100000:3.0:1788832204.903107:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+25:11435:x1875726202638592:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788832204.903127:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832204.903145:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537972 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04816 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832204.903253:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b283537979 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832204.903268:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b283537979 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832204.903280:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b283537979 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832204.903290:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788832204.903380:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537972 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04816 expref: 28 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832204.903396:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b283537979 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04816 expref: 27 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832204.903405:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:3.0:1788832204.903408:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788832204.903411:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dda00, rc 0) 00000100:00100000:3.0:1788832204.903468:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+27:11435:x1875726202638592:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 363us (510us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788832204.903476:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 145 00000100:00100000:2.0:1788832204.911909:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832204.914939:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202638720 00000100:00100000:3.0:1788832204.914954:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202638720 00000100:00100000:3.0:1788832204.915023:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 146 00000100:00100000:3.0:1788832204.915034:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+27:11435:x1875726202638720:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:3.0:1788832204.915105:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b283537987 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832204.915130:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b283537987 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832204.915142:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b283537987 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832204.915180:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b283537987 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832204.915187:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b283537987 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832204.915194:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b283537987 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832204.915201:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832204.915205:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b283537987 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832204.915212:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b283537987 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832204.915224:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:3.0:1788832204.915228:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788832204.915232:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b283537987 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832204.915239:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc000/0x998c12b283537987 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832204.915324:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+27:11435:x1875726202638720:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 292us (3422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832204.915338:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 146 00000100:00100000:0.0:1788832205.026816:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832205.027249:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202638848 00000100:00100000:3.0:1788832205.027259:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202638848 00000100:00100000:3.0:1788832205.027375:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:3.0:1788832205.027387:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+6:2395:x1875726202638848:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:3.0:1788832205.027407:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832205.027430:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098ff7157/0x998c12b28353798e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0481d expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788832205.027458:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f69c9, atime: 0x6a9f69c8, ctime: 0x6a9f69c9, blocks: 0x8 00010000:00010000:3.0:1788832205.027479:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788832205.027484:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832205.027495:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098ff7157/0x998c12b28353798e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0481d expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832205.027514:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000098ff7157/0x998c12b28353798e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0481d expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832205.027529:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dc000, rc 0) 00000100:00100000:3.0:1788832205.027596:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+7:2395:x1875726202638848:12345-192.168.203.26@tcp:101:cat.0 Request processed in 212us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832205.027603:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:2.0:1788832205.030999:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832205.031479:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202638976 00000100:00100000:0.0:1788832205.031489:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202638976 00002000:00100000:0.0:1788832205.031553:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9d2b07f12300 x1875726202638976/t0(0) o3->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:146/0 lens 488/0 e 0 to 0 dl 1788832216 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788832205.031565:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2b07f12300 with x1875726202638976 ext(0->4095) 00002000:00010000:0.0:1788832205.031570:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d2b07f12300 00000100:00100000:0.0:1788832205.031682:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:0.0:1788832205.031694:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:352fff76-09db-42cd-818a-16e788a01abb+7:2396:x1875726202638976:12345-192.168.203.26@tcp:3:cat.0 00000100:00100000:0.0:1788832205.031894:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:352fff76-09db-42cd-818a-16e788a01abb+7:2396:x1875726202638976:12345-192.168.203.26@tcp:3:cat.0 Request processed in 201us (903us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788832205.031902:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 4 00002000:00100000:0.0:1788832205.031910:0:8445:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9d2b07f12300 x1875726202638976/t0(0) o3->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:146/0 lens 488/4536 e 0 to 0 dl 1788832216 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788832205.031918:0:8445:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2b07f12300 with x1875726202638976 ext(0->4095) 00002000:00010000:0.0:1788832205.031921:0:8445:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d2b07f12300 00010000:00010000:3.0:1788832205.271064:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788832206.048099:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:1.0:1788832206.299386:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832206.550942:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788832206.550965:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fde0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218429568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832206.551038:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832206.551286:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218429568 00000100:00100000:0.0:1788832206.551294:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218429568 00000100:00100000:0.0:1788832206.551346:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788832206.551356:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218429568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788832206.551391:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788832206.551445:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218429568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832206.551452:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788832206.551534:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fde0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218429568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832207.066433:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fde0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218429696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788832207.066509:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832207.066818:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218429696 00000100:00100000:0.0:1788832207.066827:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218429696 00000100:00100000:0.0:1788832207.066879:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788832207.066888:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218429696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788832207.066936:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788832207.066985:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218429696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832207.066992:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788832207.067034:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fde0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218429696:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788832207.318857:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788832207.318866:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788832207.318884:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788832207.318893:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788832207.319120:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832207.575909:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218429824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832207.575977:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832207.576106:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218429824 00000100:00100000:1.0:1788832207.576114:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218429824 00000100:00100000:1.0:1788832207.576183:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788832207.576195:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218429824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788832207.576227:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832207.576277:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07df7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218429824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832207.576284:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788832207.576323:0:3651:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1788832207.576330:0:3651:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1788832207.576349:0:3651:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d2b07dddf80, transno 4294967305 00000100:00100000:1.0:1788832207.576367:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218429824:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788832207.576831:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788832207.579981:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218429952:0@lo:400:kworker.0 00000100:00100000:0.0:1788832207.580052:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832207.580149:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218429952 00000100:00100000:1.0:1788832207.580157:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218429952 00000100:00100000:1.0:1788832207.580213:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1788832207.580222:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:3652:x1875726218429952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832207.580564:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:3652:x1875726218429952:12345-0@lo:400:kworker.0 Request processed in 342us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832207.580573:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788832207.581040:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218429952:0@lo:400:kworker.0 00000100:00100000:0.0:1788832207.581057:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788832207.581064:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218430336:0@lo:400:kworker.0 00000100:00100000:0.0:1788832207.581094:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832207.581162:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218430336 00000100:00100000:1.0:1788832207.581167:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218430336 00000100:00100000:1.0:1788832207.581199:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788832207.581206:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218430336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832207.581251:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218430336:12345-0@lo:400:kworker.0 Request processed in 46us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832207.581258:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788832207.581317:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218430336:0@lo:400:kworker.0 00000100:00100000:3.0:1788832207.581512:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1875726218430464:0@lo:400:kworker.0 00000100:00100000:3.0:1788832207.581541:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832207.581610:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788832207.581616:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218430848:0@lo:400:kworker.0 00000100:00100000:3.0:1788832207.581664:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832207.581731:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218430848 00000100:00100000:0.0:1788832207.581735:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218430848 00000100:00100000:1.0:1788832207.581788:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218430464 00000100:00100000:0.0:1788832207.581793:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788832207.581795:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218430464 00000100:00100000:0.0:1788832207.581803:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1875726218430848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832207.581835:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788832207.581845:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875726218430464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832207.581852:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07df6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1875726218430848:12345-0@lo:400:kworker.0 Request processed in 50us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832207.581859:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788832207.581892:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875726218430464:12345-0@lo:400:kworker.0 Request processed in 49us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832207.581899:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:3.0:1788832207.582128:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788832207.582134:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788832207.582320:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218430848:0@lo:400:kworker.0 00000100:00100000:3.0:1788832207.582755:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1875726218430464:0@lo:400:kworker.0 00000100:00100000:2.0:1788832207.583604:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218430080:0@lo:400:kworker.0 00000100:00100000:3.0:1788832207.583608:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1875726218430976:0@lo:400:kworker.0 00000001:00080000:1.0:1788832207.583897:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1788832207.583925:0:6504:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d2c404b0840 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788832207.583930:0:6504:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d2c0a0f9700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d2c404b0f00 00000020:00080000:1.0:1788832207.583934:0:6504:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d2c04d67900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d2b066e3e00 00010000:00010000:0.0:1788832207.583950:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537909 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788832207.583956:0:6504:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:0.0:1788832207.583964:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537909 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832207.583972:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537909 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788832207.583973:0:6557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00010000:00010000:0.0:1788832207.584000:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dd600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832207.584005:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537909 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832207.584014:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537909 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832207.584031:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:0.0:1788832207.584034:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832207.584039:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537909 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832207.584045:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537909 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788832207.584046:0:6557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1788832207.587952:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832207.588045:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832207.588134:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218430592:0@lo:400:kworker.0 00000100:00100000:2.0:1788832207.588184:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875726218430208:0@lo:400:kworker.0 00000100:00100000:2.0:1788832207.588315:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832207.594957:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218430080 00000100:00100000:1.0:1788832207.594973:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218430080 00000100:00100000:2.0:1788832207.595171:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218430720:0@lo:400:kworker.0 00000100:00100000:2.0:1788832207.595227:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832207.595245:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218431232:0@lo:400:kworker.0 00000100:00100000:2.0:1788832207.595264:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832207.595298:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218430720 00000100:00100000:2.0:1788832207.595302:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218430720 00000100:00100000:2.0:1788832207.595338:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218431232 00000100:00100000:2.0:1788832207.595340:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218431232 00000100:00100000:2.0:1788832207.595363:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788832207.595371:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218430720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832207.595420:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218430720:12345-0@lo:400:kworker.0 Request processed in 49us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832207.595426:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788832207.595455:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788832207.595461:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218431232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832207.595487:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218431232:12345-0@lo:400:kworker.0 Request processed in 27us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832207.595492:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1788832207.595508:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788832207.595512:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832207.595524:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832207.595638:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218430976 00000100:00100000:0.0:1788832207.595642:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218430976 00000100:00100000:1.0:1788832207.599821:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218430208 00000100:00100000:1.0:1788832207.599837:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218430208 00000100:00100000:3.0:1788832207.599980:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788832207.599994:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218430080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832207.600088:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218430080:12345-0@lo:400:kworker.0 Request processed in 97us (12322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832207.600096:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788832207.600117:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788832207.600125:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875726218430976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832207.600161:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1875726218430976:12345-0@lo:400:kworker.0 Request processed in 37us (12117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832207.600167:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788832207.600179:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788832207.600185:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875726218430208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832207.600879:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218430592 00000100:00100000:0.0:1788832207.600888:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218430592 00000100:00100000:0.0:1788832207.600923:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788832207.600931:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218430592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832207.604372:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218431104:0@lo:400:kworker.0 00000100:00100000:2.0:1788832207.604444:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832207.604499:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218430080:0@lo:400:kworker.0 00000100:00080000:2.0:1788832207.604536:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788832207.604542:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832207.604571:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875726218430208:0@lo:400:kworker.0 00000100:00100000:2.0:1788832207.604585:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218430720:0@lo:400:kworker.0 00000100:00100000:2.0:1788832207.604596:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218431232:0@lo:400:kworker.0 00000100:00100000:2.0:1788832207.605141:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1875726218430976:0@lo:400:kworker.0 00000100:00100000:1.0:1788832207.605474:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218431104 00000100:00100000:1.0:1788832207.605481:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218431104 00000100:00100000:1.0:1788832207.605541:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788832207.605576:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218431104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832207.605675:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218431104:12345-0@lo:400:kworker.0 Request processed in 101us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832207.605682:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00010000:00080000:1.0:1788832207.605733:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07f13100 x1875726218431104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832207.605745:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218431104:0@lo:400:kworker.0 00000100:00080000:2.0:1788832207.606088:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788832207.606910:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875726218430208:12345-0@lo:400:kworker.0 Request processed in 6720us (18590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832207.606921:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788832207.607169:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218430592:12345-0@lo:400:kworker.0 Request processed in 6237us (11642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832207.607175:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00010000:00080000:2.0:1788832207.607532:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07f10380 x1875726218430592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832207.607546:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218430592:0@lo:400:kworker.0 00000040:00080000:1.0:1788832207.770616:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788832208.090187:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218431360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788832208.090268:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832208.091085:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218431360 00000100:00100000:1.0:1788832208.091097:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218431360 00000100:00100000:1.0:1788832208.091155:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788832208.091166:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218431360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788832208.091192:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832208.091260:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07df4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218431360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832208.091267:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788832208.091611:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218431360:0@lo:13:osp-pre-1-1.0 00000001:00080000:3.0:1788832208.092977:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:3.0:1788832208.092989:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00010000:00010000:3.0:1788832208.342874:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832208.600011:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ec0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218431488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788832208.600092:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832208.600236:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218431488 00000100:00100000:1.0:1788832208.600245:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218431488 00000100:00100000:1.0:1788832208.600302:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788832208.600312:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218431488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788832208.600342:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788832208.600392:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218431488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832208.600399:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788832208.600488:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ec0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218431488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788832209.111260:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218431616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788832209.111353:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832209.111432:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218431616 00000100:00100000:3.0:1788832209.111441:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218431616 00000100:00100000:3.0:1788832209.111488:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788832209.111498:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218431616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788832209.111518:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788832209.111557:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07df4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218431616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832209.111564:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1788832209.111582:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788832209.111606:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967314 gen 2 00000004:00080000:3.0:1788832209.111612:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967314 committed transno 4294967314 00000100:00100000:3.0:1788832209.111661:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218431616:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788832209.366788:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832209.631492:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832209.631540:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832209.631597:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832209.631653:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832209.631666:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202639616 00000100:00100000:2.0:1788832209.631670:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832209.631680:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202639616 00000100:00100000:2.0:1788832209.631683:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832209.631717:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832209.631738:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202639488 00000100:00100000:2.0:1788832209.631742:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202639488 00000100:00100000:0.0:1788832209.631763:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 113 00000100:00100000:2.0:1788832209.631769:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 114 00000100:00100000:0.0:1788832209.631773:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202639616:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832209.631775:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202639488:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832209.631841:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202639616:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 68us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832209.631848:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 113 00000100:00100000:1.0:1788832209.631861:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202639104 00000100:00100000:1.0:1788832209.631871:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202639104 00000100:00100000:1.0:1788832209.631913:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 381 00000100:00100000:1.0:1788832209.631920:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2393:x1875726202639104:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832209.631982:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202639360 00000100:00100000:3.0:1788832209.631987:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202639360 00000100:00100000:3.0:1788832209.632117:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202639872 00000100:00100000:3.0:1788832209.632120:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202639872 00000100:00100000:0.0:1788832209.632260:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202639232 00000100:00100000:0.0:1788832209.632265:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202639232 00000100:00100000:0.0:1788832209.632285:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202639744 00000100:00100000:0.0:1788832209.632288:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202639744 00000100:00100000:0.0:1788832209.632433:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 289 00000100:00100000:0.0:1788832209.632440:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202639360:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832209.632736:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 290 00000100:00100000:3.0:1788832209.632764:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202639872:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832209.633665:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202639488:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 1883us (1973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832209.633676:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 114 00000100:00080000:2.0:1788832209.633885:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788832209.633890:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788832209.633893:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788832209.633896:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788832209.633917:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 291 00000100:00100000:2.0:1788832209.633927:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+13:2393:x1875726202639232:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832209.633971:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+13:2393:x1875726202639232:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 47us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832209.633978:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 291 00000100:00100000:2.0:1788832209.633996:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 292 00000100:00100000:2.0:1788832209.634003:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202639744:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832209.634029:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202639744:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (2310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832209.634036:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 292 00000100:00100000:1.0:1788832209.635272:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2393:x1875726202639104:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 3345us (3781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832209.635285:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 381 00000100:00100000:0.0:1788832209.636317:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202639360:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 3871us (4770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832209.636328:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 289 00000100:00100000:3.0:1788832209.640878:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202639872:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 8103us (9210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832209.640894:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 290 00000100:00100000:1.0:1788832209.968125:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832209.968243:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202640000 00000100:00100000:2.0:1788832209.968253:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202640000 00000100:00100000:2.0:1788832209.968323:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 147 00000100:00100000:2.0:1788832209.968334:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+13:11080:x1875726202640000:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788832209.968456:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+13:11080:x1875726202640000:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 Request processed in 123us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832209.968463:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 147 00000100:00100000:2.0:1788832209.979334:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832209.979437:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202640128 00000100:00100000:1.0:1788832209.979447:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202640128 00000100:00100000:1.0:1788832209.979519:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 148 00000100:00100000:1.0:1788832209.979529:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+5:11080:x1875726202640128:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788832209.979668:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+5:11080:x1875726202640128:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 Request processed in 140us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832209.979675:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 148 00000100:00100000:3.0:1788832209.985356:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832209.985483:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202640384 00000100:00100000:0.0:1788832209.985494:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202640384 00000100:00100000:0.0:1788832209.985553:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:0.0:1788832209.985566:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+13:11080:x1875726202640384:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788832209.985850:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+14:11080:x1875726202640384:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 285us (501us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788832209.985858:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:2.0:1788832210.290429:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832210.290655:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202640512 00000100:00100000:3.0:1788832210.290666:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202640512 00000100:00100000:3.0:1788832210.290738:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 149 00000100:00100000:3.0:1788832210.290750:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:11894:x1875726202640512:12345-192.168.203.26@tcp:101:lsof.0 00010000:00010000:3.0:1788832210.290773:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832210.290806:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537995 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04824 expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832210.290874:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b28353799c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832210.290888:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b28353799c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832210.290902:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b28353799c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832210.290950:0:8742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788832210.290954:0:8742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788832210.290996:0:8742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b28353799c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832210.291021:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537995 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04824 expref: 7 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832210.291059:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b28353799c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04824 expref: 6 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832210.291067:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c0ad05b00) 00010000:00010000:3.0:1788832210.291071:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788832210.291074:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dd600, rc 0) 00000100:00100000:3.0:1788832210.291219:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:11894:x1875726202640512:12345-192.168.203.26@tcp:101:lsof.0 Request processed in 470us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832210.291227:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 149 00010000:00010000:1.0:1788832210.391198:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832211.414804:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832211.672123:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788832211.672149:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fde0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218431744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788832211.672227:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832211.672410:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218431744 00000100:00100000:2.0:1788832211.672420:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218431744 00000100:00100000:2.0:1788832211.672475:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788832211.672486:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218431744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788832211.672522:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788832211.672581:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218431744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832211.672587:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788832211.672764:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fde0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218431744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788832212.182899:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fde0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218431872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788832212.182997:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832212.183169:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218431872 00000100:00100000:0.0:1788832212.183178:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218431872 00000100:00100000:0.0:1788832212.183250:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788832212.183276:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218431872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788832212.183313:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788832212.183374:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218431872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832212.183381:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788832212.183502:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fde0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218431872:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788832212.439213:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832212.695901:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875726218432256:0@lo:400:kworker.0 00000100:00100000:3.0:1788832212.695974:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832212.696029:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218432768:0@lo:400:kworker.0 00000100:00100000:3.0:1788832212.696053:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832212.696075:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218433280:0@lo:400:kworker.0 00000100:00100000:3.0:1788832212.696097:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832212.696124:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788832212.696130:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07df5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218432128:0@lo:400:kworker.0 00000100:00100000:3.0:1788832212.696156:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832212.696174:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218432640:0@lo:400:kworker.0 00000100:00100000:3.0:1788832212.696195:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832212.696213:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1875726218433152:0@lo:400:kworker.0 00000100:00100000:3.0:1788832212.696245:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832212.696277:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218432256 00000100:00100000:3.0:1788832212.696285:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218432256 00000100:00100000:3.0:1788832212.696322:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218432768 00000100:00100000:3.0:1788832212.696326:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218432768 00000100:00100000:3.0:1788832212.696347:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218433280 00000100:00100000:3.0:1788832212.696350:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218433280 00000100:00100000:3.0:1788832212.696361:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218432640 00000100:00100000:3.0:1788832212.696364:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218432640 00000100:00100000:3.0:1788832212.696374:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218433152 00000100:00100000:3.0:1788832212.696377:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218433152 00000100:00100000:3.0:1788832212.696393:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788832212.696402:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875726218432256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832212.696458:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875726218432256:12345-0@lo:400:kworker.0 Request processed in 56us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832212.696465:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788832212.696484:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788832212.696489:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218432768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832212.696516:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218432768:12345-0@lo:400:kworker.0 Request processed in 27us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832212.696522:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788832212.696533:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788832212.696539:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218433280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832212.696564:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218433280:12345-0@lo:400:kworker.0 Request processed in 25us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832212.696569:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788832212.696580:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788832212.696586:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218432640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832212.696648:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218432640:12345-0@lo:400:kworker.0 Request processed in 34us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832212.696655:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788832212.696668:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788832212.696687:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875726218433152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832212.696713:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875726218433152:12345-0@lo:400:kworker.0 Request processed in 29us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832212.696719:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788832212.696755:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07df6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218432640:0@lo:400:kworker.0 00000100:00100000:3.0:1788832212.696765:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1875726218433152:0@lo:400:kworker.0 00000100:00100000:3.0:1788832212.696773:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07df5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875726218432256:0@lo:400:kworker.0 00010000:00080000:3.0:1788832212.696785:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07f0df80 x1875726218432768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832212.696794:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218432768:0@lo:400:kworker.0 00010000:00080000:3.0:1788832212.696803:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07f0c000 x1875726218433280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832212.696812:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218433280:0@lo:400:kworker.0 00000100:00080000:2.0:1788832212.696906:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788832212.696910:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788832212.696974:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218432128 00000100:00100000:1.0:1788832212.696979:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218432128 00000100:00100000:1.0:1788832212.697016:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788832212.697023:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:3654:x1875726218432128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832212.697076:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:3654:x1875726218432128:12345-0@lo:400:kworker.0 Request processed in 53us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832212.697092:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788832212.697133:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218432384:0@lo:400:kworker.0 00000100:00100000:1.0:1788832212.697159:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832212.697180:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218432896:0@lo:400:kworker.0 00000100:00100000:1.0:1788832212.697201:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832212.697218:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218433408:0@lo:400:kworker.0 00000100:00100000:1.0:1788832212.697238:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832212.697256:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788832212.697262:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218432000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832212.697282:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832212.697301:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218432512:0@lo:400:kworker.0 00000100:00100000:1.0:1788832212.697323:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832212.697340:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218433024:0@lo:400:kworker.0 00000100:00100000:1.0:1788832212.697360:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832212.697374:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218433536:0@lo:400:kworker.0 00000100:00100000:1.0:1788832212.697392:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832212.697416:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218432896 00000100:00100000:1.0:1788832212.697420:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218432896 00000100:00100000:1.0:1788832212.697449:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218433408 00000100:00100000:1.0:1788832212.697452:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218433408 00000100:00100000:1.0:1788832212.697464:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218433024 00000100:00100000:1.0:1788832212.697466:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218433024 00000100:00100000:1.0:1788832212.697475:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218433536 00000100:00100000:1.0:1788832212.697477:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218433536 00000100:00100000:1.0:1788832212.697490:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788832212.697495:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218432896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832212.697538:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218432896:12345-0@lo:400:kworker.0 Request processed in 42us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832212.697544:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788832212.697558:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788832212.697563:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218433408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832212.697591:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218433408:12345-0@lo:400:kworker.0 Request processed in 28us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832212.697598:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788832212.697609:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788832212.697614:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ec0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218433024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832212.697668:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ec0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218433024:12345-0@lo:400:kworker.0 Request processed in 54us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832212.697683:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788832212.697695:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788832212.697701:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ec0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218433536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832212.697730:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ec0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218433536:12345-0@lo:400:kworker.0 Request processed in 30us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832212.697735:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788832212.697753:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218432000 00000100:00100000:1.0:1788832212.697756:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218432000 00000100:00100000:1.0:1788832212.697777:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788832212.697784:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218432000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788832212.697806:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832212.697836:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218432000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832212.697854:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788832212.697875:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218432512 00000100:00100000:1.0:1788832212.697880:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218432512 00000100:00100000:1.0:1788832212.697902:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788832212.697908:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218432512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832212.697940:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218432512:12345-0@lo:400:kworker.0 Request processed in 32us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832212.697946:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788832212.697981:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218432000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832212.697992:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07df5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218432512:0@lo:400:kworker.0 00000100:00100000:1.0:1788832212.698000:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218433024:0@lo:400:kworker.0 00000100:00100000:1.0:1788832212.698007:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218433536:0@lo:400:kworker.0 00000100:00100000:1.0:1788832212.698015:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218432896:0@lo:400:kworker.0 00000100:00100000:1.0:1788832212.698023:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218433408:0@lo:400:kworker.0 00000100:00100000:1.0:1788832212.698051:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218432384 00000100:00100000:1.0:1788832212.698054:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218432384 00000100:00100000:1.0:1788832212.698077:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788832212.698083:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218432384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832212.698116:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218432384:12345-0@lo:400:kworker.0 Request processed in 33us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832212.698122:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788832212.698148:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07df7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218432384:0@lo:400:kworker.0 00000100:00080000:2.0:1788832212.698249:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788832212.698253:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832212.698272:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07df5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218432128:0@lo:400:kworker.0 00000001:00080000:0.0:1788832212.701338:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1788832212.701354:0:6504:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1788832212.702369:0:6557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1788832212.702406:0:6557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788832213.207418:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788832213.210127:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218433664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788832213.210211:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832213.210567:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218433664 00000100:00100000:1.0:1788832213.210578:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218433664 00000100:00100000:1.0:1788832213.210651:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788832213.210661:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218433664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788832213.210703:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832213.210777:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218433664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832213.210785:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788832213.210949:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218433664:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788832213.462784:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832213.719043:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788832213.719068:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ec0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218433792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788832213.719151:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832213.719390:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218433792 00000100:00100000:1.0:1788832213.719398:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218433792 00000100:00100000:1.0:1788832213.719452:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788832213.719462:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fde0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218433792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788832213.719498:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788832213.719556:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fde0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218433792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832213.719563:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788832213.719709:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ec0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218433792:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1788832214.230331:0:14564:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 21:50:13 (1788832213) 00000100:00100000:1.0:1788832214.234067:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218433920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788832214.234148:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832214.234226:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218433920 00000100:00100000:1.0:1788832214.234235:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218433920 00000100:00100000:1.0:1788832214.234294:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788832214.234305:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218433920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832214.234331:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788832214.234375:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218433920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832214.234399:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1788832214.234420:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832214.234453:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218433920:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788832214.488558:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832214.743229:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832214.743296:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832214.743331:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832214.743361:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832214.743395:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832214.743415:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832214.743442:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832214.743469:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202640896 00000100:00100000:0.0:1788832214.743480:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202640896 00000100:00100000:0.0:1788832214.743539:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202641408 00000100:00100000:0.0:1788832214.743542:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202641408 00000100:00100000:0.0:1788832214.743558:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202640768 00000100:00100000:0.0:1788832214.743560:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202640768 00000100:00100000:0.0:1788832214.743572:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202641280 00000100:00100000:0.0:1788832214.743575:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202641280 00000100:00100000:0.0:1788832214.743592:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 299 00000100:00100000:0.0:1788832214.743602:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202640896:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832214.743741:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202640896:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 139us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832214.743749:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 299 00000100:00100000:0.0:1788832214.743770:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 300 00000100:00100000:0.0:1788832214.743777:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2395:x1875726202641408:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832214.743801:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2395:x1875726202641408:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 25us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832214.743807:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 300 00000100:00100000:0.0:1788832214.743820:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 301 00000100:00100000:0.0:1788832214.743826:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+13:2395:x1875726202640768:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832214.743855:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+13:2395:x1875726202640768:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 29us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832214.743861:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 301 00000100:00100000:0.0:1788832214.743873:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 302 00000100:00100000:0.0:1788832214.743879:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:2395:x1875726202641280:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832214.743900:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:2395:x1875726202641280:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 22us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832214.743906:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 302 00000100:00100000:0.0:1788832214.743925:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202641152 00000100:00100000:0.0:1788832214.743928:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202641152 00000100:00100000:0.0:1788832214.743951:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202641024 00000100:00100000:0.0:1788832214.743954:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202641024 00000100:00100000:0.0:1788832214.743974:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 119 00000100:00100000:0.0:1788832214.743980:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202641152:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832214.744014:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202641152:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 33us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832214.744020:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 119 00000100:00100000:0.0:1788832214.744031:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 120 00000100:00100000:0.0:1788832214.744037:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+6:2395:x1875726202641024:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832214.744061:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e776680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+6:2395:x1875726202641024:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832214.744067:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 120 00000100:00080000:0.0:1788832214.744086:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788832214.744090:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788832214.744092:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788832214.744094:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788832214.744738:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202640640 00000100:00100000:1.0:1788832214.744744:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202640640 00000100:00100000:1.0:1788832214.744787:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 383 00000100:00100000:1.0:1788832214.744796:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3913d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2395:x1875726202640640:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832214.744841:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3913d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2395:x1875726202640640:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 48us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832214.744848:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 383 00010000:00010000:1.0:1788832215.515928:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832216.195530:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832216.196347:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202641664 00000100:00100000:1.0:1788832216.196358:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202641664 00000100:00100000:1.0:1788832216.196446:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 150 00000100:00100000:1.0:1788832216.196459:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+13:12161:x1875726202641664:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788832216.196480:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832216.196501:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b2835379a3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0482b expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.196593:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835379aa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.196608:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835379aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.196686:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835379aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.196723:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835379b1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.196731:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835379b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.196737:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835379b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.196843:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835379b8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.196852:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835379b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.196858:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835379b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832216.196867:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788832216.196950:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835379aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.197029:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835379aa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.197035:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835379aa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.197040:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832216.197045:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835379aa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.197062:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835379aa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.197074:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d2c03837700) 00010000:00010000:1.0:1788832216.197076:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832216.197081:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835379aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.197086:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b2835379aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.197099:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835379b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.197105:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835379b1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.197110:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835379b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.197115:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832216.197118:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835379b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.197123:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835379b1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.197130:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d2c100ce500) 00010000:00010000:1.0:1788832216.197132:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832216.197134:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835379b1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.197148:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835379b1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788832216.197739:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788832216.198293:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b2835379a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0482b expref: 16 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.198314:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835379b8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0482b expref: 15 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832216.198323:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d2b073ae800) 00010000:00010000:1.0:1788832216.198325:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832216.198328:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cffe00, rc 0) 00000100:00100000:1.0:1788832216.198445:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+15:12161:x1875726202641664:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 1988us (2924us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788832216.198453:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 150 00000100:00100000:0.0:1788832216.210799:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832216.210890:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832216.211075:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202641792 00000100:00100000:2.0:1788832216.211084:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202641792 00000100:00100000:2.0:1788832216.211144:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 151 00000100:00100000:2.0:1788832216.211154:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+15:12161:x1875726202641792:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788832216.211248:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202641920 00000100:00100000:3.0:1788832216.211253:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202641920 00000100:00100000:2.0:1788832216.211258:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+16:12161:x1875726202641792:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 Request processed in 106us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832216.211266:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 151 00000100:00100000:3.0:1788832216.211284:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:3.0:1788832216.211291:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c09478c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+15:2396:x1875726202641920:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832216.211302:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832216.211339:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835379b8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0482b expref: 15 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832216.211356:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d2b073ae800) 00010000:00010000:3.0:1788832216.211362:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832216.211381:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c09478c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+14:2396:x1875726202641920:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 91us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832216.211388:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:2.0:1788832216.214899:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832216.215100:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202642048 00000100:00100000:1.0:1788832216.215111:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202642048 00000100:00100000:1.0:1788832216.215190:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 152 00000100:00100000:1.0:1788832216.215201:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+5:12161:x1875726202642048:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788832216.215309:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+5:12161:x1875726202642048:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 Request processed in 110us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832216.215317:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 152 00000100:00080000:0.0:1788832216.215391:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788832216.534730:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788832216.534814:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832216.534820:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832216.535312:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788832216.535322:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788832216.791475:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832216.791499:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218434048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832216.791562:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832216.791829:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218434048 00000100:00100000:3.0:1788832216.791837:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218434048 00000100:00100000:3.0:1788832216.791880:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788832216.791890:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218434048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788832216.791922:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788832216.792014:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218434048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832216.792022:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788832216.793856:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218434048:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788832216.985187:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788832217.304256:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832217.304280:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218434176:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788832217.304349:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832217.304758:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218434176 00000100:00100000:3.0:1788832217.304767:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218434176 00000100:00100000:3.0:1788832217.304826:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788832217.304837:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218434176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788832217.304872:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788832217.304928:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218434176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832217.304936:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788832217.304983:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218434176:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788832217.559784:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788832217.560203:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832217.560221:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832217.560360:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1788832217.560369:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788832217.814910:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218434432:0@lo:400:kworker.0 00000100:00100000:3.0:1788832217.815012:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832217.815080:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218434944:0@lo:400:kworker.0 00000100:00100000:3.0:1788832217.815106:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832217.815120:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218434304:0@lo:400:kworker.0 00000100:00100000:3.0:1788832217.815130:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218435456:0@lo:400:kworker.0 00000100:00100000:0.0:1788832217.816709:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218434688:0@lo:400:kworker.0 00000100:00100000:3.0:1788832217.817604:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832217.817715:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788832217.817728:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218434560:0@lo:400:kworker.0 00000100:00100000:3.0:1788832217.817767:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832217.817789:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218435072:0@lo:400:kworker.0 00000100:00100000:3.0:1788832217.817815:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832217.817837:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218435584:0@lo:400:kworker.0 00000100:00100000:3.0:1788832217.817859:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832217.817908:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218434432 00000100:00100000:3.0:1788832217.817917:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218434432 00000100:00100000:3.0:1788832217.817976:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218434944 00000100:00100000:3.0:1788832217.817980:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218434944 00000100:00100000:3.0:1788832217.818005:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218435456 00000100:00100000:3.0:1788832217.818008:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218435456 00000100:00100000:3.0:1788832217.818021:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218434560 00000100:00100000:3.0:1788832217.818024:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218434560 00000100:00100000:3.0:1788832217.818040:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788832217.818049:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218434432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832217.818113:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218434432:12345-0@lo:400:kworker.0 Request processed in 65us (3101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832217.818121:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788832217.818140:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788832217.818147:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218434944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832217.818205:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218434944:12345-0@lo:400:kworker.0 Request processed in 58us (3097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832217.818218:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788832217.818240:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788832217.818247:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875726218435456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832217.818276:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875726218435456:12345-0@lo:400:kworker.0 Request processed in 30us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832217.818283:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788832217.818295:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788832217.818301:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218434560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832217.819587:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218434560:12345-0@lo:400:kworker.0 Request processed in 1281us (1814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832217.819598:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788832217.819680:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218435072 00000100:00100000:3.0:1788832217.819688:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218435072 00000100:00100000:3.0:1788832217.819745:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218435584 00000100:00100000:3.0:1788832217.819749:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218435584 00000100:00100000:3.0:1788832217.819772:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788832217.819780:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218435072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832217.819819:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07df5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218435072:12345-0@lo:400:kworker.0 Request processed in 39us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832217.819825:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788832217.819836:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788832217.819842:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218435584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832217.819870:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218435584:12345-0@lo:400:kworker.0 Request processed in 29us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832217.819889:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1788832217.819917:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788832217.819922:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788832217.819925:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788832217.822592:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218434560:0@lo:400:kworker.0 00000100:00100000:3.0:1788832217.822614:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218435072:0@lo:400:kworker.0 00000100:00100000:3.0:1788832217.822658:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218435584:0@lo:400:kworker.0 00000100:00100000:3.0:1788832217.822674:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218434432:0@lo:400:kworker.0 00010000:00080000:3.0:1788832217.822692:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07f0c700 x1875726218434944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832217.822704:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218434944:0@lo:400:kworker.0 00010000:00080000:3.0:1788832217.822718:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07f0d500 x1875726218435456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832217.822725:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218435456:0@lo:400:kworker.0 00000100:00100000:1.0:1788832217.825123:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832217.825246:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218434816:0@lo:400:kworker.0 00000100:00100000:1.0:1788832217.825557:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832217.825584:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1875726218435328:0@lo:400:kworker.0 00000100:00100000:1.0:1788832217.825608:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832217.825736:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218434816 00000100:00100000:1.0:1788832217.825745:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218434816 00000100:00100000:1.0:1788832217.825806:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218435328 00000100:00100000:1.0:1788832217.825809:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218435328 00000100:00100000:1.0:1788832217.825837:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788832217.825847:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218434816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832217.825905:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218434816:12345-0@lo:400:kworker.0 Request processed in 59us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832217.825913:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788832217.825932:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788832217.825938:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875726218435328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832217.825966:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875726218435328:12345-0@lo:400:kworker.0 Request processed in 28us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832217.825972:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00080000:1.0:1788832217.825996:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832217.826016:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218435840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832217.826047:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832217.826087:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218434816:0@lo:400:kworker.0 00000100:00100000:1.0:1788832217.826099:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1875726218435328:0@lo:400:kworker.0 00000100:00100000:1.0:1788832217.826149:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218435840 00000100:00100000:1.0:1788832217.826153:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218435840 00000100:00100000:1.0:1788832217.826530:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788832217.826539:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218435840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788832217.826567:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832217.826610:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218435840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832217.826617:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1788832217.826676:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788832217.826706:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218435840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832217.826895:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218434304 00000100:00100000:2.0:1788832217.826901:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218434304 00000100:00100000:2.0:1788832217.826950:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1788832217.826958:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3654:x1875726218434304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832217.827005:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3654:x1875726218434304:12345-0@lo:400:kworker.0 Request processed in 47us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832217.827011:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788832217.827445:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832217.827498:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218435200:0@lo:400:kworker.0 00000100:00100000:0.0:1788832217.827527:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832217.827546:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218435712:0@lo:400:kworker.0 00000100:00100000:0.0:1788832217.827567:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832217.827603:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218435200 00000100:00100000:0.0:1788832217.827607:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218435200 00000100:00100000:2.0:1788832217.827790:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218434688 00000100:00100000:2.0:1788832217.827794:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218434688 00000100:00100000:2.0:1788832217.827835:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788832217.827841:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218434688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832217.827899:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218434688:12345-0@lo:400:kworker.0 Request processed in 57us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832217.827906:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788832217.828037:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218435712 00000100:00100000:0.0:1788832217.828041:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218435712 00000100:00100000:0.0:1788832217.828063:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788832217.828069:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218435200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832217.828105:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218435200:12345-0@lo:400:kworker.0 Request processed in 36us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832217.828111:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788832217.828126:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788832217.828131:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218435712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832217.828170:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218435712:12345-0@lo:400:kworker.0 Request processed in 39us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832217.828176:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788832217.828426:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218434688:0@lo:400:kworker.0 00000100:00100000:0.0:1788832217.828438:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218435200:0@lo:400:kworker.0 00000100:00100000:0.0:1788832217.828447:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218435712:0@lo:400:kworker.0 00000100:00100000:1.0:1788832217.828547:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218434304:0@lo:400:kworker.0 00000100:00080000:2.0:1788832217.830819:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788832218.007286:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788832218.262883:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832218.262972:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202642176 00000100:00100000:1.0:1788832218.262982:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202642176 00000100:00100000:1.0:1788832218.263063:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 153 00000100:00100000:1.0:1788832218.263073:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+14:12204:x1875726202642176:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788832218.263092:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832218.263113:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835379c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04832 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788832218.263137:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788832218.263178:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263196:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263211:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263246:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263254:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263261:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263303:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263310:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263316:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263322:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfee00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832218.263326:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263339:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263351:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c0ad05b00) 00010000:00010000:1.0:1788832218.263353:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832218.263357:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263363:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263382:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263388:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263392:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263397:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832218.263399:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263405:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263412:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d2c100ce500) 00010000:00010000:1.0:1788832218.263414:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832218.263417:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263422:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263450:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835379c6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04832 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263459:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c0ad05b00) 00010000:00010000:1.0:1788832218.263461:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832218.263471:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835379c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04832 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.263481:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe000, rc 0) 00000100:00100000:1.0:1788832218.263547:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+14:12204:x1875726202642176:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 475us (673us total) trans 0 rc 301/301 00000100:00100000:1.0:1788832218.263554:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 153 00000100:00100000:3.0:1788832218.281909:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832218.282791:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202642432 00000100:00100000:1.0:1788832218.282852:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202642432 00000100:00100000:1.0:1788832218.282976:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 154 00000100:00100000:1.0:1788832218.282994:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+14:12204:x1875726202642432:12345-192.168.203.26@tcp:36:lfs.0 00010000:00010000:1.0:1788832218.283081:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832218.283119:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b28353731a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04656 expref: 14 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.283146:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c0ad05b00) 00010000:00010000:1.0:1788832218.283153:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788832218.283241:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835379db lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.283262:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b28353799c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04824 expref: 5 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.283274:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835379db lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.283967:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b28353799c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04824 expref: 5 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.284019:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b28353799c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04824 expref: 5 pid: 8742 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832218.284040:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1875726218435968:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788832218.284176:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832218.293573:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832218.293726:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202642560 00000100:00100000:0.0:1788832218.293742:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202642560 00010000:00010000:0.0:1788832218.293815:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b28353799c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04824 expref: 6 pid: 8742 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788832218.293823:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832218.293879:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 78 00000100:00100000:0.0:1788832218.293892:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07df5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:2394:x1875726202642560:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832218.293910:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832218.293920:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b28353799c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04824 expref: 6 pid: 8742 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.293937:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b28353799c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04824 expref: 6 pid: 8742 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.293964:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c0ad05b00) 00010000:00010000:0.0:1788832218.293969:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835379db lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.293984:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b28353799c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04824 expref: 6 pid: 8742 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.293984:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835379db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.294031:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835379db lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832218.294050:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1875726218435968:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788832218.294059:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788832218.294088:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835379db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.294101:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835379db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.294109:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835379db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832218.294135:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07df5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2394:x1875726202642560:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 242us (572us total) trans 0 rc 0/0 00010000:00010000:1.0:1788832218.294144:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379e2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832218.294152:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 78 00010000:00010000:1.0:1788832218.294175:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.294188:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.295073:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.295098:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.295107:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788832218.295131:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a02332b reply state 00000000000fc7e7 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.295147:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.295155:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:1.0:1788832218.295158:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788832218.295162:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788832218.295170:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788832218.295179:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835379db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.295186:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835379db lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.295194:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835379db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.295201:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832218.295207:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835379db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.295216:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835379db lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.295239:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c0ad05b00) 00010000:00010000:1.0:1788832218.295242:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832218.295246:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835379db lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.295252:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835379db lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788832218.295272:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a02332b reply state 00000000000fc7e7 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.295281:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.295287:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d2c100ce500) 00010000:00010000:1.0:1788832218.295289:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788832218.295291:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788832218.295404:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+15:12204:x1875726202642432:12345-192.168.203.26@tcp:36:lfs.0 Request processed in 12412us (15095us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788832218.295417:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 154 00000100:00100000:0.0:1788832218.327127:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218436096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788832218.327256:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832218.327450:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218436096 00000100:00100000:1.0:1788832218.327461:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218436096 00000100:00100000:1.0:1788832218.327530:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788832218.327542:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218436096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788832218.327571:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832218.327665:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36da2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218436096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832218.327674:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788832218.327986:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218436096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788832218.429005:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832218.432612:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202642688 00000100:00100000:1.0:1788832218.432653:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202642688 00000100:00100000:2.0:1788832218.435472:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 155 00000100:00100000:2.0:1788832218.435497:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+15:12212:x1875726202642688:12345-192.168.203.26@tcp:101:lctl.0 00010000:00010000:2.0:1788832218.435527:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832218.435551:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b2835379f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04839 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.435655:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835379f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.435669:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835379f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.435681:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835379f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832218.435733:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788832218.435736:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788832218.435760:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835379f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.435785:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b2835379f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04839 expref: 17 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.435808:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835379f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04839 expref: 16 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.435831:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c36bdbe00) 00010000:00010000:2.0:1788832218.435834:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788832218.435838:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031000, rc 0) 00000100:00100000:2.0:1788832218.435960:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+16:12212:x1875726202642688:12345-192.168.203.26@tcp:101:lctl.0 Request processed in 468us (6964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832218.435967:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 155 00000100:00100000:0.0:1788832218.513928:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832218.515142:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202642816 00000100:00100000:1.0:1788832218.515155:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202642816 00000100:00100000:0.0:1788832218.516787:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 156 00000100:00100000:0.0:1788832218.516801:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+16:12218:x1875726202642816:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1788832218.516822:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832218.516844:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c200/0x998c12b2835379fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04840 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.516929:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537a05 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.516954:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537a05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.516965:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537a05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.516976:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537a0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.516983:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537a0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.516990:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537a0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.517068:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537a13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.517076:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537a13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.517100:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537a13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832218.517133:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788832218.517137:0:13811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788832218.517168:0:13811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537a13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.517186:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537a05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.517198:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537a05 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.517205:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537a05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.517211:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0d800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832218.517215:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537a05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.517222:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537a05 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.517234:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c36bdbe00) 00010000:00010000:0.0:1788832218.517236:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832218.517241:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537a05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.517246:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537a05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.517269:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537a0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.517274:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537a0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.517296:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537a0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.517301:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0cc00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832218.517305:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537a0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.517311:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537a0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.517319:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d2c100ce500) 00010000:00010000:0.0:1788832218.517321:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832218.517324:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537a0c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.517329:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537a0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.517355:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c200/0x998c12b2835379fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04840 expref: 18 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.517369:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537a13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04840 expref: 17 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.517387:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:0.0:1788832218.517389:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788832218.517392:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0ca00, rc 0) 00000100:00100000:0.0:1788832218.517479:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+17:12218:x1875726202642816:12345-192.168.203.26@tcp:101:bash.0 Request processed in 681us (3558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832218.517486:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 156 00000100:00100000:3.0:1788832218.523402:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832218.523521:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202643072 00000100:00100000:1.0:1788832218.523531:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202643072 00000100:00100000:1.0:1788832218.523589:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 157 00000100:00100000:1.0:1788832218.523600:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+17:12218:x1875726202643072:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1788832218.523663:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832218.523686:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537a1a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04847 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.523790:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537a21 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.523806:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537a21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.523817:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537a21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.525223:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537a28 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.525242:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537a28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.525253:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537a28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788832218.525597:0:6525:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788832218.525773:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537a2f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.525795:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537a2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.525804:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537a2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.525840:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537a21 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.525848:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537a21 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.525855:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537a21 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.525861:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832218.525866:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537a21 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.525873:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537a21 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.525885:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:1.0:1788832218.525888:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832218.525892:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537a21 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.525897:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537a21 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788832218.525909:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce29faf7 reply state 0000000093c0b88b transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537a28 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.525925:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537a28 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.525931:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2c100ced00) 00010000:00010000:1.0:1788832218.525933:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788832218.525936:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788832218.525973:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537a1a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04847 expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.525987:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537a2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04847 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.525994:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce800) 00010000:00010000:1.0:1788832218.525996:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832218.525998:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cff200, rc 0) 00000100:00100000:1.0:1788832218.526071:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+20:12218:x1875726202643072:12345-192.168.203.26@tcp:101:bash.0 Request processed in 2472us (2680us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1788832218.526079:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 157 00000100:00100000:2.0:1788832218.531290:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832218.531353:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202643200 00000100:00100000:3.0:1788832218.531372:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202643200 00000100:00100000:3.0:1788832218.531453:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:3.0:1788832218.531465:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202643200:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788832218.531498:0:10097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832218.531519:0:10097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a3d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0484e expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788832218.531546:0:10097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832218.531566:0:10097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1788832218.531571:0:10097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832218.531581:0:10097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0484e expref: 6 pid: 10097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.531601:0:10097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0484e expref: 6 pid: 10097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.531615:0:10097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dca00, rc 0) 00000100:00100000:3.0:1788832218.531720:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202643200:12345-192.168.203.26@tcp:101:bash.0 Request processed in 257us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832218.531727:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00080000:2.0:1788832218.531801:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788832218.546721:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832218.546856:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202643328 00000100:00100000:3.0:1788832218.546867:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202643328 00000100:00100000:3.0:1788832218.546969:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:3.0:1788832218.546980:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+6:12218:x1875726202643328:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788832218.546998:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832218.547016:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e26c6f6d/0x998c12b283537a44 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04855 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.547045:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a3d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0484e expref: 7 pid: 10097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.547066:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832218.547070:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832218.547076:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e26c6f6d/0x998c12b283537a44 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04855 expref: 7 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.547108:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0484e expref: 7 pid: 10097 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.547121:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0484e expref: 7 pid: 10097 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832218.547136:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8442:1875726218436224:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788832218.547510:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36de8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832218.556185:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8442:1875726218436224:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788832218.556397:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e26c6f6d/0x998c12b283537a44 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04855 expref: 7 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.556420:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dc600, rc 0) 00000100:00100000:3.0:1788832218.556536:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+7:12218:x1875726202643328:12345-192.168.203.26@tcp:101:bash.0 Request processed in 9557us (9823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832218.556545:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:2.0:1788832218.564484:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832218.564586:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202643456 00000100:00100000:3.0:1788832218.564597:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202643456 00010000:00010000:3.0:1788832218.564686:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0484e expref: 7 pid: 10097 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832218.564737:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 79 00000100:00100000:3.0:1788832218.564747:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+7:2394:x1875726202643456:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832218.564761:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832218.564782:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0484e expref: 7 pid: 10097 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.564795:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0484e expref: 7 pid: 10097 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.564817:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a3d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0484e expref: 7 pid: 10097 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.564835:0:10344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832218.564839:0:10344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832218.564847:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e26c6f6d/0x998c12b283537a44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04855 expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.564868:0:10344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e26c6f6d/0x998c12b283537a44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04855 expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.564904:0:10344:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e26c6f6d/0x998c12b283537a44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04855 expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832218.564916:0:10344:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10344:1875726218436352:192.168.203.26@tcp:105: 00000100:00100000:3.0:1788832218.565029:0:10344:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36de8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788832218.571793:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832218.571827:0:10344:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10344:1875726218436352:192.168.203.26@tcp:105: 00010000:00010000:3.0:1788832218.571853:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832218.571914:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+6:2394:x1875726202643456:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 7168us (7438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832218.571925:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 79 00000100:00100000:1.0:1788832218.571949:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202643712 00000100:00100000:1.0:1788832218.571956:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202643712 00000100:00100000:1.0:1788832218.572001:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:1.0:1788832218.572010:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+20:12218:x1875726202643712:12345-192.168.203.26@tcp:35:bash.0 00000001:00080000:1.0:1788832218.572497:0:6528:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967420 00000100:00100000:1.0:1788832218.572597:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+22:12218:x1875726202643712:12345-192.168.203.26@tcp:35:bash.0 Request processed in 588us (814us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1788832218.572604:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 36 00000020:00080000:1.0:1788832218.572661:0:6528:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788832218.583263:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832218.682731:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832218.683045:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202643968 00000100:00100000:2.0:1788832218.683055:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202643968 00000100:00100000:2.0:1788832218.683172:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 158 00000100:00100000:2.0:1788832218.683184:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+22:12228:x1875726202643968:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788832218.683211:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832218.683236:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537a4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0485c expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832218.683349:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788832218.683475:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537a4b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0485c expref: 24 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.683489:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c36bdbe00) 00010000:00010000:2.0:1788832218.683492:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788832218.683497:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537a4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0485c expref: 24 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.683531:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031c00, rc 0) 00000100:00100000:2.0:1788832218.683603:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+23:12228:x1875726202643968:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 420us (883us total) trans 4294967422 rc 301/301 00000100:00100000:2.0:1788832218.683611:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 158 00000100:00100000:0.0:1788832218.689288:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832218.689375:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202644224 00000100:00100000:3.0:1788832218.689386:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202644224 00000100:00100000:3.0:1788832218.689456:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 37 00000100:00100000:3.0:1788832218.689468:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+23:12228:x1875726202644224:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788832218.689730:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+24:12228:x1875726202644224:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 264us (452us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1788832218.689738:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 37 00000100:00100000:0.0:1788832218.764965:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832218.765073:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202644352 00000100:00100000:2.0:1788832218.765083:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202644352 00000100:00100000:2.0:1788832218.765149:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 159 00000100:00100000:2.0:1788832218.765167:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+24:12234:x1875726202644352:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788832218.765193:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832218.765212:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537a59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04863 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.765291:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537a60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.765306:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537a60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.765318:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537a60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832218.765372:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788832218.765375:0:13811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788832218.765394:0:13811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537a60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.765607:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537a59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04863 expref: 26 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.765712:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537a60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04863 expref: 25 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.765722:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:2.0:1788832218.765725:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788832218.765729:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031e00, rc 0) 00000100:00100000:2.0:1788832218.765791:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+25:12234:x1875726202644352:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 625us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832218.765799:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 159 00000100:00100000:0.0:1788832218.773732:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832218.773831:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202644608 00000100:00100000:1.0:1788832218.773841:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202644608 00000100:00100000:1.0:1788832218.773905:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 160 00000100:00100000:1.0:1788832218.773916:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+25:12234:x1875726202644608:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788832218.773937:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832218.773958:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537a67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0486a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.774058:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537a6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.774071:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537a6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.774082:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537a6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832218.774092:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788832218.774212:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537a67 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0486a expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.774242:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537a6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0486a expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.774251:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce800) 00010000:00010000:1.0:1788832218.774253:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832218.774257:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe000, rc 0) 00000100:00100000:1.0:1788832218.774312:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+27:12234:x1875726202644608:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 397us (588us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1788832218.774332:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 160 00000100:00100000:0.0:1788832218.779198:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832218.779508:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202644864 00000100:00100000:3.0:1788832218.779518:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202644864 00000100:00100000:3.0:1788832218.779584:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 161 00000100:00100000:3.0:1788832218.779596:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+27:12234:x1875726202644864:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788832218.779765:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832218.779787:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537a7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04871 expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.780168:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537a83 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.780184:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537a83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.780217:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537a83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832218.780305:0:8742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788832218.780726:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537a7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04871 expref: 30 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.780745:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537a83 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04871 expref: 29 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.780754:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce800) 00010000:00010000:3.0:1788832218.780757:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788832218.780761:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092ddc00, rc 0) 00000100:00100000:3.0:1788832218.780834:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+29:12234:x1875726202644864:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1240us (1644us total) trans 4294967425 rc 0/0 00000100:00100000:3.0:1788832218.780844:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 161 00000100:00100000:0.0:1788832218.783667:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832218.783822:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202644992 00000100:00100000:2.0:1788832218.783831:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202644992 00000100:00100000:2.0:1788832218.783893:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:2.0:1788832218.783902:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+29:2394:x1875726202644992:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832218.783918:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832218.783943:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537a6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0486a expref: 29 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.783960:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce800) 00010000:00010000:2.0:1788832218.783966:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832218.784026:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+28:2394:x1875726202644992:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 124us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832218.784032:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:0.0:1788832218.793760:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832218.793842:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202645120 00000100:00100000:3.0:1788832218.793851:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202645120 00000100:00100000:3.0:1788832218.793911:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:3.0:1788832218.793921:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+6:2394:x1875726202645120:12345-192.168.203.26@tcp:1:lfs.0 00010000:00010000:3.0:1788832218.793966:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a91 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.793987:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e26c6f6d/0x998c12b283537a44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04855 expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.793996:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832218.794010:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788832218.794015:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a91 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.794051:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e26c6f6d/0x998c12b283537a44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04855 expref: 6 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.794065:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e26c6f6d/0x998c12b283537a44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04855 expref: 6 pid: 8442 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832218.794080:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8440:1875726218436480:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788832218.794440:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36de8540 going to sleep for 11 seconds 00000100:00100000:3.0:1788832218.797582:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8440:1875726218436480:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788832218.797613:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a91 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832218.798770:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832218.798888:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202645248 00000100:00100000:3.0:1788832218.798895:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202645248 00002000:00100000:3.0:1788832218.798950:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9d2c04dc5500 x1875726202645248/t0(0) o4->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:159/0 lens 504/0 e 0 to 0 dl 1788832229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788832218.798960:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2c04dc5500 with x1875726202645248 ext(0->12) 00010000:00010000:3.0:1788832218.798970:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e26c6f6d/0x998c12b283537a44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04855 expref: 7 pid: 8442 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.798984:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e26c6f6d/0x998c12b283537a44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04855 expref: 7 pid: 8442 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788832218.799010:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d2c04dc5500 00000100:00100000:3.0:1788832218.799044:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:3.0:1788832218.799053:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:352fff76-09db-42cd-818a-16e788a01abb+7:2393:x1875726202645248:12345-192.168.203.26@tcp:4:lfs.0 00000100:00100000:3.0:1788832218.800875:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:352fff76-09db-42cd-818a-16e788a01abb+9:2393:x1875726202645248:12345-192.168.203.26@tcp:4:lfs.0 Request processed in 1811us (2100us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788832218.800891:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 2 00002000:00100000:3.0:1788832218.800905:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9d2c04dc5500 x1875726202645248/t4294967306(0) o4->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:159/0 lens 504/448 e 0 to 0 dl 1788832229 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788832218.800916:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2c04dc5500 with x1875726202645248 ext(0->12) 00010000:00010000:3.0:1788832218.800927:0:8446:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e26c6f6d/0x998c12b283537a44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04855 expref: 9 pid: 8442 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.800945:0:8446:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e26c6f6d/0x998c12b283537a44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04855 expref: 9 pid: 8442 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788832218.800954:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d2c04dc5500 00000100:00100000:0.0:1788832218.806243:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832218.806896:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202645376 00000100:00100000:1.0:1788832218.806909:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202645376 00010000:00010000:1.0:1788832218.806956:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e26c6f6d/0x998c12b283537a44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04855 expref: 9 pid: 8442 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832218.807009:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 80 00000100:00100000:1.0:1788832218.807019:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:352fff76-09db-42cd-818a-16e788a01abb+9:2394:x1875726202645376:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832218.807032:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788832218.807050:0:6512:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788832218.807054:0:6512:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788832219 00002000:00010000:1.0:1788832218.807056:0:6512:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788832219 00002000:00010000:1.0:1788832218.807058:0:6512:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788832219 00002000:00010000:1.0:1788832218.807061:0:6512:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788832218.807067:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e26c6f6d/0x998c12b283537a44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04855 expref: 9 pid: 8442 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.807081:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e26c6f6d/0x998c12b283537a44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04855 expref: 9 pid: 8442 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.807104:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e26c6f6d/0x998c12b283537a44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04855 expref: 9 pid: 8442 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.807122:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788832218.807126:0:6512:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788832218.807132:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.807301:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a91 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.807402:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832218.807463:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:352fff76-09db-42cd-818a-16e788a01abb+8:2394:x1875726202645376:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 444us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832218.807471:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 80 00010000:00010000:3.0:1788832218.809044:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.809063:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.809093:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.809115:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.809123:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.809131:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dca00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:3.0:1788832218.809135:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.809157:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.809177:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a91 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.809186:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078a7d62f/0x998c12b283537a91 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832218.809289:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+7:2394:x1875726202645120:12345-192.168.203.26@tcp:1:lfs.0 Request processed in 15365us (15535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832218.809298:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:0.0:1788832218.813444:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832218.813574:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202645632 00000100:00100000:3.0:1788832218.813585:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202645632 00000100:00100000:3.0:1788832218.813771:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:3.0:1788832218.813799:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18f2b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+28:12234:x1875726202645632:12345-192.168.203.26@tcp:35:lfs.0 00000004:00010000:3.0:1788832218.813871:0:6529:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537a83 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04871 expref: 28 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788832218.814069:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788832218.814105:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:3.0:1788832218.815473:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:3.0:1788832218.815546:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537a98 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.815563:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537a2f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04847 expref: 32 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.815573:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537a98 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.815608:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537a2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04847 expref: 32 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.815661:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537a2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04847 expref: 32 pid: 6525 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832218.815675:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6529:1875726218436608:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788832218.815845:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832218.825700:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6529:1875726218436608:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788832218.825731:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537a98 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832218.825990:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832218.826128:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202645760 00000100:00100000:2.0:1788832218.826136:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202645760 00010000:00010000:2.0:1788832218.826179:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537a2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04847 expref: 33 pid: 6525 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832218.826224:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 81 00000100:00100000:2.0:1788832218.826234:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+33:2393:x1875726202645760:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832218.826250:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832218.826258:0:7466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537a2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04847 expref: 33 pid: 6525 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.826270:0:7466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537a2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04847 expref: 33 pid: 6525 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.826293:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537a2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04847 expref: 33 pid: 6525 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.826309:0:7466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce800) 00010000:00010000:2.0:1788832218.826314:0:7466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537a98 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.826322:0:7466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537a98 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.826328:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537a98 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.826357:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832218.826416:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+32:2393:x1875726202645760:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 183us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832218.826424:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 81 00010000:00010000:0.0:1788832218.830833:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537a98 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832218.830852:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537a98 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788832218.831001:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:0.0:1788832218.831127:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1788832218.831266:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc18000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1875726218436736:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788832218.831346:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832218.831386:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7240 going to sleep for 11 seconds 00000100:00100000:1.0:1788832218.831454:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218436736 00000100:00100000:1.0:1788832218.831463:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218436736 00000100:00100000:1.0:1788832218.831518:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788832218.831528:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6529:x1875726218436736:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788832218.831665:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6529:x1875726218436736:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 138us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832218.831672:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788832218.831997:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc18000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1875726218436736:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788832218.832112:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:0.0:1788832218.832159:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc18000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1875726218436864:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788832218.832191:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832218.832272:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832218.838302:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218436864 00000100:00100000:3.0:1788832218.838318:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218436864 00000100:00100000:3.0:1788832218.838384:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788832218.838396:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6529:x1875726218436864:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788832218.838808:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832218.838839:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218436992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832218.838883:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832218.838927:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218436992 00000100:00100000:2.0:1788832218.838931:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218436992 00000100:00100000:2.0:1788832218.838962:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788832218.838969:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218436992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788832218.839010:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788832218.839049:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218436992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832218.839056:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788832218.839108:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218436992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788832218.839299:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6529:x1875726218436864:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 904us (7105us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788832218.839307:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788832218.840656:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc18000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1875726218436864:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788832218.840823:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1788832218.840885:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537a98 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.840907:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537a98 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.840915:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537a98 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.840921:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832218.840926:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537a98 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.840934:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537a98 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.840952:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce800) 00010000:00010000:2.0:1788832218.840954:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788832218.840988:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537a98 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.840995:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537a98 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788832218.841112:0:6529:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788832218.841178:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1788832218.841189:0:6529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358881567792ns, next at 359881566080ns, rc = 0 00000001:00080000:2.0:1788832218.841196:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:2.0:1788832218.841220:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce800) 00010000:00010000:2.0:1788832218.841223:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788832218.841230:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537a83 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04871 expref: 36 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832218.841348:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18f2b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+35:12234:x1875726202645632:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 27550us (27915us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788832218.841357:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 38 00000020:00080000:2.0:1788832218.841361:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788832218.875328:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832218.875432:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202645888 00000100:00100000:1.0:1788832218.875443:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202645888 00000100:00100000:1.0:1788832218.875508:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 162 00000100:00100000:1.0:1788832218.875518:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+35:12234:x1875726202645888:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788832218.875542:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832218.875565:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537a9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04878 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.875666:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537a9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04878 expref: 36 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.875702:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537a9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04878 expref: 36 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832218.875724:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:1.0:1788832218.875727:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788832218.875731:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfec00, rc 0) 00000100:00100000:1.0:1788832218.875784:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+36:12234:x1875726202645888:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 267us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832218.875791:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 162 00000100:00100000:0.0:1788832218.881713:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832218.881867:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202646144 00000100:00100000:1.0:1788832218.881877:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202646144 00000100:00100000:1.0:1788832218.881938:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:1.0:1788832218.881948:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+36:12234:x1875726202646144:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1788832218.882210:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+37:12234:x1875726202646144:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 262us (505us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1788832218.882218:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:0.0:1788832218.989106:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832218.989338:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202646400 00000100:00100000:2.0:1788832218.989348:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202646400 00000100:00100000:2.0:1788832218.989412:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 163 00000100:00100000:2.0:1788832218.989422:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+37:12244:x1875726202646400:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788832218.989452:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832218.989472:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537aa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0487f expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832218.989607:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788832218.989796:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537aa6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0487f expref: 39 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.989831:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c36bdbe00) 00010000:00010000:2.0:1788832218.989834:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788832218.989840:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537aa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0487f expref: 39 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832218.989863:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00030c00, rc 0) 00000100:00100000:2.0:1788832218.989950:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+38:12244:x1875726202646400:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 529us (854us total) trans 4294967436 rc 301/301 00000100:00100000:2.0:1788832218.989958:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 163 00000100:00100000:0.0:1788832218.992498:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832218.992660:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202646528 00000100:00100000:3.0:1788832218.992669:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202646528 00000100:00100000:3.0:1788832218.992727:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 164 00000100:00100000:3.0:1788832218.992737:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+38:12244:x1875726202646528:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:3.0:1788832218.992819:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537ab4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.992839:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537ab4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.992853:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537ab4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.992865:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537abb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.992872:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537abb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.992879:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537abb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.992987:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537ac2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.992997:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993004:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788832218.993058:0:8742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993071:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537ab4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993078:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537ab4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993084:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993090:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dca00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832218.993095:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993102:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537ab4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993114:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:3.0:1788832218.993117:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832218.993122:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537ab4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993135:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537ab4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993149:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537abb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993155:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537abb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993161:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537abb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993165:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092ddc00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832218.993168:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537abb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993174:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537abb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993182:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2c100ced00) 00010000:00010000:3.0:1788832218.993185:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832218.993188:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537abb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993194:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537abb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993204:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993209:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537ac2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993222:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993462:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832218.993466:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993483:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993493:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:3.0:1788832218.993496:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832218.993499:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537ac2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832218.993505:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537ac2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832218.993595:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+38:12244:x1875726202646528:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 857us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832218.993603:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 164 00000100:00100000:1.0:1788832219.003940:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832219.004030:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202646784 00000100:00100000:3.0:1788832219.004040:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202646784 00000100:00100000:3.0:1788832219.004098:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:3.0:1788832219.004107:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+38:12244:x1875726202646784:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788832219.004329:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+39:12244:x1875726202646784:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 222us (398us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788832219.004336:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:0.0:1788832219.054596:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832219.054854:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202647040 00000100:00100000:3.0:1788832219.054863:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202647040 00000100:00100000:3.0:1788832219.054930:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 165 00000100:00100000:3.0:1788832219.054942:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+39:12247:x1875726202647040:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788832219.054970:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832219.054994:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537ac9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04886 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055074:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537ad0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055089:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537ad0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055102:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537ad0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055112:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537ad7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055119:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055124:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055241:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537ade lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055250:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537ade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055277:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537ade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832219.055289:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788832219.055368:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537ad0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055376:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537ad0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055383:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055390:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092ddc00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832219.055399:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537ad0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055406:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537ad0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055417:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:3.0:1788832219.055420:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832219.055425:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537ad0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055430:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537ad0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055442:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055448:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537ad7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055460:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055465:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dca00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832219.055468:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055474:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537ad7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055483:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2c100ced00) 00010000:00010000:3.0:1788832219.055485:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832219.055488:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537ad7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055493:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537ad7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055541:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537ac9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04886 expref: 42 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055554:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537ade lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04886 expref: 41 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.055561:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:3.0:1788832219.055563:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788832219.055565:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dc600, rc 0) 00000100:00100000:3.0:1788832219.055910:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+41:12247:x1875726202647040:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 970us (1322us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788832219.055928:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 165 00000100:00100000:0.0:1788832219.068452:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832219.074533:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202647168 00000100:00100000:2.0:1788832219.074548:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202647168 00000100:00100000:2.0:1788832219.074654:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 166 00000100:00100000:2.0:1788832219.074665:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+41:12247:x1875726202647168:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:2.0:1788832219.074748:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537aec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.074766:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537aec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.074779:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537aec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.074817:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537aec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.074825:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537aec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.074851:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537aec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.074857:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030c00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832219.074863:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537aec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.074872:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537aec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.074885:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:2.0:1788832219.074888:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788832219.074893:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537aec lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.074900:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537aec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832219.074997:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+41:12247:x1875726202647168:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 333us (6556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832219.075005:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 166 00000100:00100000:1.0:1788832219.082738:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832219.085852:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202647424 00000100:00100000:3.0:1788832219.085871:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202647424 00000100:00100000:3.0:1788832219.085951:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:3.0:1788832219.085963:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+41:12247:x1875726202647424:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788832219.086232:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+42:12247:x1875726202647424:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 263us (3495us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788832219.086241:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:0.0:1788832219.351073:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07dddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218437120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788832219.351141:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832219.351382:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218437120 00000100:00100000:2.0:1788832219.351390:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218437120 00000100:00100000:2.0:1788832219.351457:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788832219.351467:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218437120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788832219.351490:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788832219.351550:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218437120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832219.351558:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788832219.351845:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07dddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218437120:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788832219.352399:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788832219.428976:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832219.429074:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202647680 00000100:00100000:3.0:1788832219.429084:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202647680 00000100:00100000:3.0:1788832219.429148:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 167 00000100:00100000:3.0:1788832219.429159:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+42:12278:x1875726202647680:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:3.0:1788832219.429182:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832219.429201:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537af3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0488d expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.429320:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537afa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.429335:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537afa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.429346:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537afa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832219.429359:0:8742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788832219.429475:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537af3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0488d expref: 45 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.429510:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537afa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0488d expref: 44 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.429519:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:3.0:1788832219.429522:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788832219.429526:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dca00, rc 0) 00000100:00100000:3.0:1788832219.429591:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+44:12278:x1875726202647680:12345-192.168.203.26@tcp:101:cat.0 Request processed in 433us (623us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1788832219.429598:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 167 00000100:00100000:0.0:1788832219.433520:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832219.433702:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202647808 00000100:00100000:2.0:1788832219.433712:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202647808 00000100:00100000:2.0:1788832219.433922:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:2.0:1788832219.433934:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+44:2394:x1875726202647808:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832219.433949:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832219.433976:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537afa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0488d expref: 44 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.433995:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:2.0:1788832219.434001:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832219.434312:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+43:2394:x1875726202647808:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 378us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832219.434320:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:2.0:1788832219.438225:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832219.438890:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202648064 00000100:00100000:3.0:1788832219.438902:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202648064 00000100:00100000:3.0:1788832219.438989:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:3.0:1788832219.439002:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+43:12278:x1875726202648064:12345-192.168.203.26@tcp:35:cat.0 00000100:00100000:3.0:1788832219.439270:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+44:12278:x1875726202648064:12345-192.168.203.26@tcp:35:cat.0 Request processed in 270us (1051us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788832219.439278:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:0.0:1788832219.484415:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832219.486025:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202648320 00000100:00100000:2.0:1788832219.486038:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202648320 00000100:00100000:2.0:1788832219.486227:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 168 00000100:00100000:2.0:1788832219.486239:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+44:12284:x1875726202648320:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:2.0:1788832219.486265:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832219.486268:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788832219.486297:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537a60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04863 expref: 44 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.486320:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:2.0:1788832219.486325:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788832219.486340:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537b08 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04894 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.486481:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537b0f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.486496:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537ade lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04886 expref: 44 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.486506:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537b0f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.486538:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537ade lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04886 expref: 44 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.486553:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537ade lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04886 expref: 44 pid: 6525 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832219.486566:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1875726218437248:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788832219.486735:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832219.489221:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1875726218437248:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832219.489320:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537b0f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832219.491005:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832219.491575:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202648448 00000100:00100000:1.0:1788832219.491586:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202648448 00010000:00010000:1.0:1788832219.491664:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537ade lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04886 expref: 45 pid: 6525 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832219.491699:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 82 00000100:00100000:1.0:1788832219.491709:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c0947a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:352fff76-09db-42cd-818a-16e788a01abb+45:2393:x1875726202648448:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832219.491737:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832219.491744:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537ade lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04886 expref: 45 pid: 6525 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832219.491758:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537ade lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04886 expref: 45 pid: 6525 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832219.491779:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537ade lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04886 expref: 45 pid: 6525 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832219.491795:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:1.0:1788832219.491800:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537b0f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832219.491809:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537b0f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832219.491817:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537b0f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832219.491931:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832219.491992:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c0947a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:352fff76-09db-42cd-818a-16e788a01abb+44:2393:x1875726202648448:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 283us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832219.491999:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 82 00010000:00010000:3.0:1788832219.492713:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537b0f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.492725:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537b0f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832219.492749:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788832219.492883:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537b08 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04894 expref: 45 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.492921:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537b0f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04894 expref: 44 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.492930:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:3.0:1788832219.492933:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788832219.492937:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031600, rc 0) 00000100:00100000:3.0:1788832219.492986:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+44:12284:x1875726202648320:12345-192.168.203.26@tcp:101:dd.0 Request processed in 6748us (8588us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788832219.492993:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 168 00000100:00100000:0.0:1788832219.495519:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832219.496006:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202648576 00000100:00100000:1.0:1788832219.496016:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202648576 00000100:00100000:1.0:1788832219.496076:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 169 00000100:00100000:1.0:1788832219.496087:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+44:12284:x1875726202648576:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:1.0:1788832219.496126:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832219.496147:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537b1d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0489b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832219.496194:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283537b24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832219.496208:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283537b24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832219.496221:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283537b24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832219.496361:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537b1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0489b expref: 46 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832219.496379:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283537b24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0489b expref: 45 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832219.496387:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:1.0:1788832219.496390:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788832219.496393:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cffe00, rc 0) 00000100:00100000:1.0:1788832219.496450:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+45:12284:x1875726202648576:12345-192.168.203.26@tcp:101:dd.0 Request processed in 364us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832219.496457:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 169 00000100:00100000:0.0:1788832219.502030:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832219.502523:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202648832 00000100:00100000:3.0:1788832219.502532:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202648832 00000100:00100000:3.0:1788832219.502657:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 170 00000100:00100000:3.0:1788832219.502668:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+45:12284:x1875726202648832:12345-192.168.203.26@tcp:36:dd.0 00010000:00010000:3.0:1788832219.502916:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537b2b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.502936:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537b2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.502949:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537b2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788832219.502991:0:8742:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1788832219.503015:0:8742:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080689df7 reply state 00000000618fd24e transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537b2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.503029:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537b2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.503052:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:3.0:1788832219.503055:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788832219.503059:0:8742:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788832219.503368:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+48:12284:x1875726202648832:12345-192.168.203.26@tcp:36:dd.0 Request processed in 700us (1344us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788832219.503376:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 170 00000020:00080000:3.0:1788832219.503381:0:8742:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788832219.606803:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832219.790434:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832219.790521:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202648960 00000100:00100000:3.0:1788832219.790531:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202648960 00000100:00100000:3.0:1788832219.790591:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 171 00000100:00100000:3.0:1788832219.790600:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+48:12298:x1875726202648960:12345-192.168.203.26@tcp:101:stat.0 00010000:00010000:3.0:1788832219.790658:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832219.790678:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537b32 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc048a2 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.790742:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537b39 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.790757:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537b39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.790768:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537b39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.790780:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537b40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.790787:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537b40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.790811:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537b40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.790880:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537b47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.790891:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537b0f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04894 expref: 49 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.790900:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537b47 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.790929:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537b0f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04894 expref: 49 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832219.790942:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537b0f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04894 expref: 49 pid: 6527 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832219.790956:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1875726218437376:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788832219.791211:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376000 going to sleep for 11 seconds 00000100:00100000:1.0:1788832219.800184:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832219.800679:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1875726218437376:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788832219.800705:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537b47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832219.800783:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202649216 00000100:00100000:2.0:1788832219.800791:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202649216 00000100:00100000:2.0:1788832219.804871:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:2.0:1788832219.804901:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+50:6637:x1875726202649216:12345-192.168.203.26@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788832219.811302:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+51:6637:x1875726202649216:12345-192.168.203.26@tcp:35:ldlm_bl.0 Request processed in 6404us (11115us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1788832219.811334:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:0.0:1788832219.814248:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832219.814605:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202649344 00000100:00100000:2.0:1788832219.814615:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202649344 00010000:00010000:2.0:1788832219.814692:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537b0f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04894 expref: 51 pid: 6527 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832219.814739:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 83 00000100:00100000:2.0:1788832219.814751:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+51:2393:x1875726202649344:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832219.814771:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832219.814779:0:7466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537b0f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04894 expref: 51 pid: 6527 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.814793:0:7466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537b0f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04894 expref: 51 pid: 6527 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.814817:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537b0f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04894 expref: 51 pid: 6527 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.814837:0:7466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:2.0:1788832219.814842:0:7466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537b47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.814852:0:7466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537b47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.814861:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537b47 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832219.814910:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832219.814968:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+50:2393:x1875726202649344:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 218us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832219.814975:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 83 00010000:00010000:0.0:1788832219.815139:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537b47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832219.815149:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537b47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832219.815221:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788832219.815227:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788832219.815253:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537b47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832219.815267:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537b47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832219.815277:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537b39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832219.815283:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537b39 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832219.815289:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537b39 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832219.815294:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dd600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832219.815299:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537b39 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832219.815307:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537b39 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832219.815317:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:0.0:1788832219.815320:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832219.815324:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537b39 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832219.815339:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd600/0x998c12b283537b39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832219.815351:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537b40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832219.815357:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537b40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832219.815362:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537b40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832219.815367:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832219.815370:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537b40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832219.815377:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537b40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832219.815386:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2c100ced00) 00010000:00010000:0.0:1788832219.815393:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832219.815396:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537b40 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832219.815402:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc600/0x998c12b283537b40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832219.815436:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092ddc00/0x998c12b283537b32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048a2 expref: 50 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832219.815452:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537b47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048a2 expref: 49 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832219.815466:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:0.0:1788832219.815468:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788832219.815471:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dca00, rc 0) 00000100:00100000:0.0:1788832219.815517:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+49:12298:x1875726202648960:12345-192.168.203.26@tcp:101:stat.0 Request processed in 24917us (25090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832219.815524:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 171 00000100:00100000:0.0:1788832219.868972:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832219.869021:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832219.869119:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202649600 00000100:00100000:3.0:1788832219.869130:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202649600 00000100:00100000:3.0:1788832219.869209:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 309 00000100:00100000:3.0:1788832219.869220:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2394:x1875726202649600:12345-192.168.203.26@tcp:400:kworker.0 00000100:00080000:1.0:1788832219.869241:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788832219.869331:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2394:x1875726202649600:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 112us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832219.869339:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 309 00000100:00100000:0.0:1788832219.869527:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832219.869557:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832219.869586:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832219.869605:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202649728 00000100:00100000:0.0:1788832219.869608:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202649728 00000100:00100000:0.0:1788832219.869682:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202649856 00000100:00100000:0.0:1788832219.869686:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202649856 00000100:00100000:0.0:1788832219.869706:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 125 00000100:00100000:0.0:1788832219.869713:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202649728:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832219.869748:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202649728:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 36us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832219.869756:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 125 00000100:00100000:0.0:1788832219.869768:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 126 00000100:00100000:0.0:1788832219.869775:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+7:2394:x1875726202649856:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832219.869803:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+7:2394:x1875726202649856:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 29us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832219.869821:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 126 00000100:00100000:0.0:1788832219.869860:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00080000:1.0:1788832219.875800:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832219.875857:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202649984 00000100:00100000:1.0:1788832219.875870:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202649984 00000100:00100000:1.0:1788832219.875943:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202650112 00000100:00100000:1.0:1788832219.875947:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202650112 00000100:00100000:1.0:1788832219.876000:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 310 00000100:00100000:1.0:1788832219.876010:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202649984:12345-192.168.203.26@tcp:400:kworker.0 00000100:00080000:3.0:1788832219.876032:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788832219.876104:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2393:x1875726202649984:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 95us (6546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832219.876112:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 310 00000100:00100000:1.0:1788832219.876133:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 311 00000100:00100000:1.0:1788832219.876141:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2394:x1875726202650112:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832219.876167:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2394:x1875726202650112:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (6307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832219.876173:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 311 00000100:00100000:2.0:1788832219.876351:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202649472 00000100:00100000:2.0:1788832219.876357:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202649472 00000100:00100000:1.0:1788832219.876903:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 385 00000100:00100000:1.0:1788832219.876913:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2393:x1875726202649472:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832219.876970:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2393:x1875726202649472:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 58us (7948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832219.876977:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 385 00000100:00100000:3.0:1788832219.927052:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832219.932258:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202650368 00000100:00100000:1.0:1788832219.932273:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202650368 00000100:00100000:1.0:1788832219.932372:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 172 00000100:00100000:1.0:1788832219.932384:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+49:12304:x1875726202650368:12345-192.168.203.26@tcp:36:truncate.0 00010000:00010000:1.0:1788832219.932481:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832219.932510:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dca00/0x998c12b283537b47 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048a2 expref: 49 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832219.932537:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:1.0:1788832219.932542:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788832219.932757:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537b4e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832219.932771:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537b4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832219.932780:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537b4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788832219.932819:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:1.0:1788832219.932841:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f17f9e6d reply state 00000000d71edf23 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537b4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832219.932853:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537b4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832219.932859:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:1.0:1788832219.932861:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788832219.932863:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788832219.932970:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+51:12304:x1875726202650368:12345-192.168.203.26@tcp:36:truncate.0 Request processed in 588us (5925us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788832219.932977:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 172 00000020:00080000:1.0:1788832219.932982:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788832220.106399:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832220.106515:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202650496 00000100:00100000:1.0:1788832220.106526:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202650496 00000100:00100000:1.0:1788832220.106608:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 173 00000100:00100000:1.0:1788832220.106673:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+51:12318:x1875726202650496:12345-192.168.203.26@tcp:101:stat.0 00010000:00010000:1.0:1788832220.106717:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832220.106740:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537b55 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc048a9 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.106807:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537b5c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.106822:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537b5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.106835:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537b5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.106846:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.106852:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.106859:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.106930:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537b6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788832220.107144:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788832220.107182:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537b6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.107190:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537b6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832220.107298:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1788832220.107379:0:13811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788832220.107404:0:13811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537b6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.107416:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537b6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.107425:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537b5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.107432:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537b5c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.107438:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537b5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.107443:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832220.107447:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537b5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.107454:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537b5c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.107466:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:1.0:1788832220.107469:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832220.107474:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537b5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.107479:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537b5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.107493:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.107510:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b63 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.107515:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.107520:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832220.107524:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.107529:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.107538:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2c100ced00) 00010000:00010000:1.0:1788832220.107541:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832220.107543:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b63 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.107549:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.107577:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537b55 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048a9 expref: 53 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.107589:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537b6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048a9 expref: 52 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.107596:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:1.0:1788832220.107598:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832220.107607:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe200, rc 0) 00000100:00100000:1.0:1788832220.107784:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+52:12318:x1875726202650496:12345-192.168.203.26@tcp:101:stat.0 Request processed in 1166us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832220.107792:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 173 00000100:00100000:3.0:1788832220.212696:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832220.213714:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202650752 00000100:00100000:0.0:1788832220.213727:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202650752 00000100:00100000:0.0:1788832220.213801:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 174 00000100:00100000:0.0:1788832220.213811:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+52:12328:x1875726202650752:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788832220.213831:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832220.213852:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537b71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc048b0 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832220.213969:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788832220.214076:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537b71 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048b0 expref: 54 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832220.214092:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c36bdbe00) 00010000:00010000:0.0:1788832220.214096:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788832220.214101:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537b71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048b0 expref: 54 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832220.214118:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0c800, rc 0) 00000100:00100000:0.0:1788832220.214187:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+53:12328:x1875726202650752:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 377us (1500us total) trans 4294967448 rc 301/301 00000100:00100000:0.0:1788832220.214195:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 174 00000100:00100000:3.0:1788832220.219699:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832220.219800:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202651008 00000100:00100000:1.0:1788832220.219809:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202651008 00000100:00100000:1.0:1788832220.219865:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:1.0:1788832220.219875:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18f29450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+53:12328:x1875726202651008:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1788832220.220090:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18f29450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+54:12328:x1875726202651008:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 216us (398us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788832220.220098:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:3.0:1788832220.305090:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832220.305195:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202651264 00000100:00100000:1.0:1788832220.305203:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202651264 00000100:00100000:1.0:1788832220.305269:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 175 00000100:00100000:1.0:1788832220.305278:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+54:12334:x1875726202651264:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1788832220.305304:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832220.305325:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537b7f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc048b7 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.305445:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b86 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.305460:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537b6a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048a9 expref: 55 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.305469:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b86 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.305519:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537b6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048a9 expref: 55 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.305532:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537b6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048a9 expref: 55 pid: 13811 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832220.305545:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ddd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1875726218437504:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788832220.305682:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c404b0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832220.310548:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832220.310827:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202651392 00000100:00100000:2.0:1788832220.310836:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202651392 00010000:00010000:2.0:1788832220.310877:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537b6a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048a9 expref: 56 pid: 13811 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832220.310921:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 84 00000100:00100000:2.0:1788832220.310932:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+56:2393:x1875726202651392:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832220.310953:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832220.310960:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537b6a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048a9 expref: 56 pid: 13811 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.310974:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537b6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048a9 expref: 56 pid: 13811 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.310998:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:2.0:1788832220.311004:0:10343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b86 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.311014:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b86 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.311021:0:10343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b86 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.311053:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832220.311113:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+56:2393:x1875726202651392:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 182us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832220.311120:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 84 00010000:00010000:1.0:1788832220.311983:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537b6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048a9 expref: 55 pid: 13811 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832220.312004:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ddd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1875726218437504:192.168.203.26@tcp:104: 00010000:00010000:1.0:1788832220.312026:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b86 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.312035:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b86 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.312040:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b86 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832220.312058:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788832220.312194:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537b7f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048b7 expref: 56 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.312208:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b86 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048b7 expref: 55 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.312240:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:1.0:1788832220.312243:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788832220.312246:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe000, rc 0) 00000100:00100000:1.0:1788832220.312292:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+55:12334:x1875726202651264:12345-192.168.203.26@tcp:101:bash.0 Request processed in 7015us (7210us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788832220.312300:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 175 00000100:00100000:3.0:1788832220.317044:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832220.317185:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202651648 00000100:00100000:1.0:1788832220.317195:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202651648 00000100:00100000:1.0:1788832220.317264:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 176 00000100:00100000:1.0:1788832220.317275:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+55:12334:x1875726202651648:12345-192.168.203.26@tcp:36:bash.0 00010000:00010000:1.0:1788832220.317500:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537b94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.317518:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537b94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.317529:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537b94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788832220.317570:0:13811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:1.0:1788832220.317591:0:13811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089d73ab1 reply state 0000000047596174 transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537b94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.317603:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537b94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.317611:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:1.0:1788832220.317614:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788832220.317764:0:13811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788832220.317856:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+58:12334:x1875726202651648:12345-192.168.203.26@tcp:36:bash.0 Request processed in 581us (819us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788832220.317863:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 176 00000020:00080000:1.0:1788832220.317869:0:13811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788832220.323568:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832220.323681:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202651776 00000100:00100000:2.0:1788832220.323691:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202651776 00000100:00100000:2.0:1788832220.323756:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 177 00000100:00100000:2.0:1788832220.323767:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+58:12334:x1875726202651776:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:2.0:1788832220.323792:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832220.323814:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537b9b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc048be expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.323904:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537ba2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.323920:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b86 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048b7 expref: 59 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.323929:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537ba2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.324014:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b86 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048b7 expref: 59 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.324028:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b86 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048b7 expref: 59 pid: 6525 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832220.324041:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1875726218437632:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788832220.324140:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032fb600 going to sleep for 11 seconds 00000100:00100000:0.0:1788832220.327005:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832220.327092:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202651904 00000100:00100000:1.0:1788832220.327101:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202651904 00010000:00010000:1.0:1788832220.327144:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b86 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048b7 expref: 60 pid: 6525 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832220.327198:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 85 00000100:00100000:1.0:1788832220.327208:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:352fff76-09db-42cd-818a-16e788a01abb+60:2393:x1875726202651904:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832220.327396:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832220.327405:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b86 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048b7 expref: 60 pid: 6525 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.327417:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b86 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048b7 expref: 60 pid: 6525 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.327440:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:1.0:1788832220.327445:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537ba2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.327454:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.327461:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537ba2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.327480:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832220.327546:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:352fff76-09db-42cd-818a-16e788a01abb+60:2393:x1875726202651904:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 339us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832220.327555:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 85 00010000:00010000:2.0:1788832220.328140:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537b86 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048b7 expref: 59 pid: 6525 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832220.328158:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1875726218437632:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832220.328480:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.328490:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.328495:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832220.328549:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788832220.328554:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788832220.328573:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.328603:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537b9b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048be expref: 59 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.328766:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048be expref: 58 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.328772:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:2.0:1788832220.328774:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832220.328777:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031e00, rc 0) 00000100:00100000:2.0:1788832220.328820:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+58:12334:x1875726202651776:12345-192.168.203.26@tcp:101:bash.0 Request processed in 5057us (5263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832220.328835:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 177 00000100:00100000:0.0:1788832220.331968:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832220.332056:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202652160 00000100:00100000:1.0:1788832220.332066:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202652160 00000100:00100000:1.0:1788832220.332125:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00100000:1.0:1788832220.332135:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+58:12334:x1875726202652160:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:1.0:1788832220.332379:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+59:12334:x1875726202652160:12345-192.168.203.26@tcp:35:bash.0 Request processed in 244us (418us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788832220.332386:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00100000:3.0:1788832220.415987:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832220.416133:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202652416 00000100:00100000:1.0:1788832220.416142:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202652416 00000100:00100000:1.0:1788832220.416213:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 178 00000100:00100000:1.0:1788832220.416232:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+59:12344:x1875726202652416:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788832220.416257:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832220.416275:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537ba9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc048c5 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832220.416387:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788832220.416494:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537ba9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048c5 expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.416507:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c36bdbe00) 00010000:00010000:1.0:1788832220.416510:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788832220.416515:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537ba9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048c5 expref: 61 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.416547:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe200, rc 0) 00000100:00100000:1.0:1788832220.416614:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+60:12344:x1875726202652416:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 392us (634us total) trans 4294967454 rc 301/301 00000100:00100000:1.0:1788832220.416684:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 178 00000100:00100000:3.0:1788832220.420607:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832220.420869:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202652544 00000100:00100000:1.0:1788832220.420879:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202652544 00000100:00100000:1.0:1788832220.420939:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 179 00000100:00100000:1.0:1788832220.420949:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+60:12344:x1875726202652544:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:1.0:1788832220.421025:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537bb7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421042:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537bb7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421053:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537bb7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421064:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537bbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421072:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537bbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421078:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537bbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421144:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537bc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421171:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421178:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788832220.421405:0:13811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421420:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537bb7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421427:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537bb7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421434:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537bb7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421440:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832220.421444:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537bb7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421452:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537bb7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421465:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:1.0:1788832220.421467:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832220.421472:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537bb7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421477:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537bb7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421499:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537bbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421505:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537bbe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421510:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537bbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421516:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832220.421519:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537bbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421525:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537bbe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421533:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2c100ced00) 00010000:00010000:1.0:1788832220.421536:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832220.421539:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537bbe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421545:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537bbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421554:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421560:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537bc5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421566:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421577:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832220.421580:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421586:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537bc5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421595:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:1.0:1788832220.421597:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832220.421599:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537bc5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.421603:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537bc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832220.421769:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+60:12344:x1875726202652544:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 820us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832220.421779:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 179 00000100:00100000:3.0:1788832220.425870:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832220.425982:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202652800 00000100:00100000:1.0:1788832220.425992:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202652800 00000100:00100000:1.0:1788832220.426046:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:1.0:1788832220.426056:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+60:12344:x1875726202652800:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1788832220.426271:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+61:12344:x1875726202652800:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 216us (410us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788832220.426280:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:1.0:1788832220.476664:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832220.476943:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202653056 00000100:00100000:2.0:1788832220.476954:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202653056 00000100:00100000:2.0:1788832220.477020:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 180 00000100:00100000:2.0:1788832220.477031:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+61:12347:x1875726202653056:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788832220.477056:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832220.477076:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537bcc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc048cc expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477149:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537bd3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477163:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537bd3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477174:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537bd3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477185:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537bda lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477192:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537bda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477199:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537bda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477326:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537be1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477470:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537be1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477478:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537be1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832220.477489:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788832220.477564:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537bd3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477572:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537bd3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477578:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537bd3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477584:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832220.477588:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537bd3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477596:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537bd3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477608:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:2.0:1788832220.477611:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832220.477615:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537bd3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477663:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537bd3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477679:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537bda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477887:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537bda lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477892:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537bda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477896:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031c00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832220.477899:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537bda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477905:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537bda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477913:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2c100ced00) 00010000:00010000:2.0:1788832220.477916:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832220.477919:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537bda lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477924:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537bda lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477967:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537bcc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048cc expref: 64 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477981:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537be1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048cc expref: 63 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.477988:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:2.0:1788832220.477991:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832220.478000:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00030c00, rc 0) 00000100:00100000:2.0:1788832220.478117:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+63:12347:x1875726202653056:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1087us (1501us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788832220.478125:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 180 00000100:00100000:0.0:1788832220.482584:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832220.482871:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202653184 00000100:00100000:3.0:1788832220.482882:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202653184 00000100:00100000:3.0:1788832220.482942:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 181 00000100:00100000:3.0:1788832220.482953:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+63:12347:x1875726202653184:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:3.0:1788832220.483020:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537bef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.483038:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537bef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.483050:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537bef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.483098:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537bef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.483105:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537bef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.483112:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537bef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.483118:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832220.483122:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537bef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.483130:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537bef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.483142:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:3.0:1788832220.483145:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788832220.483150:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537bef lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.483156:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537bef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832220.483492:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+63:12347:x1875726202653184:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 540us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832220.483500:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 181 00000100:00100000:3.0:1788832220.485790:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832220.485913:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202653440 00000100:00100000:1.0:1788832220.485922:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202653440 00000100:00100000:1.0:1788832220.485986:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:1.0:1788832220.485995:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+63:12347:x1875726202653440:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1788832220.486503:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+64:12347:x1875726202653440:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 507us (718us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1788832220.486511:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:0.0:1788832220.488506:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832220.490658:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202653568 00000100:00100000:2.0:1788832220.490673:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202653568 00000100:00100000:2.0:1788832220.490749:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:2.0:1788832220.490759:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+64:2394:x1875726202653568:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832220.490775:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832220.490803:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537be1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048cc expref: 64 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.490824:0:7466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:2.0:1788832220.490829:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832220.490889:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+63:2394:x1875726202653568:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 132us (2390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832220.490896:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 15 00010000:00010000:3.0:1788832220.631048:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832220.634834:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832220.634939:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202653824 00000100:00100000:2.0:1788832220.634948:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202653824 00000100:00100000:2.0:1788832220.635007:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 182 00000100:00100000:2.0:1788832220.635016:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+63:12365:x1875726202653824:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:2.0:1788832220.635039:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832220.635059:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537bf6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc048d3 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.635164:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537bfd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.635195:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537bfd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.635206:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537bfd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832220.635228:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788832220.635347:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537bf6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048d3 expref: 66 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.635369:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537bfd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048d3 expref: 65 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.635378:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:2.0:1788832220.635381:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788832220.635385:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031c00, rc 0) 00000100:00100000:2.0:1788832220.635450:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+65:12365:x1875726202653824:12345-192.168.203.26@tcp:101:cat.0 Request processed in 435us (628us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788832220.635459:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 182 00000100:00100000:2.0:1788832220.656899:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832220.656998:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202653952 00000100:00100000:1.0:1788832220.657009:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202653952 00000100:00100000:1.0:1788832220.657070:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 183 00000100:00100000:1.0:1788832220.657080:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+65:12366:x1875726202653952:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788832220.657105:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832220.657129:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537c0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc048da expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.657200:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537c12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.657216:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537c12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.657227:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537c12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832220.657286:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788832220.657291:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788832220.657320:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537c12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.657771:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537c0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048da expref: 67 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.657807:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537c12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048da expref: 66 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832220.657816:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:1.0:1788832220.657819:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788832220.657823:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe200, rc 0) 00000100:00100000:1.0:1788832220.657894:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+66:12366:x1875726202653952:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 815us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832220.657901:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 183 00000100:00100000:0.0:1788832220.669063:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832220.669203:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202654336 00000100:00100000:3.0:1788832220.669387:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202654336 00000100:00100000:3.0:1788832220.669496:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:3.0:1788832220.669509:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+66:12366:x1875726202654336:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788832220.669879:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+67:12366:x1875726202654336:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 372us (823us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788832220.669888:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:3.0:1788832220.672013:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832220.672113:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202654464 00000100:00100000:2.0:1788832220.675569:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202654464 00000100:00100000:2.0:1788832220.675694:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:2.0:1788832220.675706:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+67:12366:x1875726202654464:12345-192.168.203.26@tcp:103:lfs.0 00010000:00010000:2.0:1788832220.675722:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788832220.675748:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537ba2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048be expref: 67 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.675799:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537bfd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048d3 expref: 66 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.675814:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537a9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04878 expref: 65 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832220.675824:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:2.0:1788832220.675830:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832220.675977:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+64:12366:x1875726202654464:12345-192.168.203.26@tcp:103:lfs.0 Request processed in 274us (3971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832220.675985:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:2.0:1788832220.683097:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832220.683219:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202654592 00000100:00100000:3.0:1788832220.683229:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202654592 00000100:00100000:3.0:1788832220.683479:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 184 00000100:00100000:3.0:1788832220.683492:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+64:12366:x1875726202654592:12345-192.168.203.26@tcp:58:lfs.0 00010000:00010000:3.0:1788832220.683807:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537c19 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.683827:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537c19 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.683842:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537c19 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788832220.683943:0:6527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788832220.684085:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+64:12366:x1875726202654592:12345-192.168.203.26@tcp:58:lfs.0 Request processed in 594us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832220.684093:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 184 00000100:00100000:1.0:1788832220.710769:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832220.717253:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202654720 00000100:00100000:3.0:1788832220.717496:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202654720 00000100:00100000:3.0:1788832220.717572:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 185 00000100:00100000:3.0:1788832220.717582:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+64:12368:x1875726202654720:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788832220.717644:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832220.717666:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537c20 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc048e1 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.717731:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c27 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.717746:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c27 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.717756:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c27 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.717765:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537c2e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.717771:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537c2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.717777:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537c2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.717841:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537c35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.717850:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537c35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.717855:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537c35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832220.717896:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788832220.717905:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788832220.717924:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537c35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.717936:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537c35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.717943:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c27 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.717949:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c27 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.717956:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c27 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.717962:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832220.717965:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c27 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.717972:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c27 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.717983:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:3.0:1788832220.717985:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832220.717990:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.717995:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c27 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.718008:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537c2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.718023:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537c2e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.718029:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537c2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.718034:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2a00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832220.718037:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537c2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.718043:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537c2e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.718051:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2c100ced00) 00010000:00010000:3.0:1788832220.718053:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832220.718056:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537c2e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.718061:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537c2e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.718086:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537c20 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048e1 expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.718098:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537c35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048e1 expref: 65 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832220.718104:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:3.0:1788832220.718106:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788832220.718115:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2800, rc 0) 00000100:00100000:3.0:1788832220.718179:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+65:12368:x1875726202654720:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 599us (7419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832220.718185:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 185 00000040:00080000:1.0:1788832221.549888:0:14711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788832221.549902:0:14711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788832221.550942:0:14711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788832221.550951:0:14711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788832221.661203:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788832221.661217:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788832221.661281:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788832221.661293:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788832221.661477:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ddfb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875726218437760:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788832221.661697:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c404b0000 going to sleep for 11 seconds 00010000:00010000:1.0:1788832221.662601:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832221.668586:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ddfb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875726218437760:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788832221.672541:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832221.672683:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202654848 00000100:00100000:1.0:1788832221.672696:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202654848 00000100:00100000:1.0:1788832221.672773:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 186 00000100:00100000:1.0:1788832221.672786:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+65:12380:x1875726202654848:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788832221.672833:0:6526:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788832221.673010:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+65:12380:x1875726202654848:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 226us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832221.673018:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 186 00000001:00080000:1.0:1788832221.675533:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1788832221.675616:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788832221.675790:0:6504:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d2b073b7240 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788832221.675796:0:6504:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d2c3e9d5d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d2b073b73c0 00000020:00080000:1.0:1788832221.675800:0:6504:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d2c3e9d5800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d2b0721de00 00000020:00080000:1.0:1788832221.675973:0:6557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1788832221.676049:0:6557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788832221.676061:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788832221.676088:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218437888:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788832221.676181:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832221.676521:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218437888 00000100:00100000:3.0:1788832221.676532:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218437888 00000100:00100000:3.0:1788832221.676779:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788832221.676793:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1875726218437888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788832221.676832:0:8440:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:3.0:1788832221.676875:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f69db, atime: 0x6a9f69db, ctime: 0x6a9f69db, blocks: 0x8 00010000:00010000:3.0:1788832221.676884:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff97bcfb/0x998c12b283537c3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.676907:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1788832221.676912:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832221.676919:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff97bcfb/0x998c12b283537c3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.676938:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff97bcfb/0x998c12b283537c3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.676950:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff97bcfb/0x998c12b283537c3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.676959:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff97bcfb/0x998c12b283537c3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.676992:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788832221.677173:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3653:x1875726218437888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 383us (991us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788832221.677182:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00010000:3.0:1788832221.677231:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832221.677239:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff97bcfb/0x998c12b283537c3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.677249:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2a00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:3.0:1788832221.677255:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff97bcfb/0x998c12b283537c3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.677265:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff97bcfb/0x998c12b283537c3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.677288:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff97bcfb/0x998c12b283537c3c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.677297:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff97bcfb/0x998c12b283537c3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.677317:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832221.677318:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832221.677320:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788832221.677373:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d2b07ddfb80/2, rc 0, transno 4294967308 00000100:00100000:3.0:1788832221.677380:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218437888:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1788832221.681512:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788832221.681994:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832221.682300:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202654976 00000100:00100000:3.0:1788832221.682313:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202654976 00000100:00100000:3.0:1788832221.682401:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 187 00000100:00100000:3.0:1788832221.682414:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+22:12380:x1875726202654976:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788832221.682514:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537c43 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.682535:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537c43 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.682550:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537c43 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683011:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683021:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683030:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683037:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832221.683043:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683052:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683078:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d2c100ce500) 00010000:00010000:2.0:1788832221.683083:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832221.683089:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379e2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683097:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b2835379e2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683123:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683130:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379e9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683136:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683141:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfee00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832221.683144:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683151:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379e9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683159:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:2.0:1788832221.683161:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832221.683164:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379e9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683170:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b2835379e9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683199:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537a28 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683204:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537a28 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683271:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537a28 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683276:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832221.683280:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537a28 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683286:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537a28 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683295:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2c100ced00) 00010000:00010000:2.0:1788832221.683298:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832221.683301:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537a28 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683307:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537a28 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683379:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537b2b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683387:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537b2b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683392:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537b2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683404:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832221.683407:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537b2b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683413:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537b2b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683421:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:2.0:1788832221.683424:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832221.683427:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537b2b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683432:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc400/0x998c12b283537b2b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683445:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537b4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683452:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537b4e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683458:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537b4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683463:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cffa00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832221.683465:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537b4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683472:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537b4e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683490:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:2.0:1788832221.683493:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832221.683496:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537b4e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683502:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537b4e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683514:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537b94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683521:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537b94 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683526:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537b94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683530:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832221.683533:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537b94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683538:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537b94 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683545:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:2.0:1788832221.683548:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832221.683550:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537b94 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.683555:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537b94 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.684081:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c4a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.684104:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c4a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.684116:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c4a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685196:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537c51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685212:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537c51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685223:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537c51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832221.685280:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788832221.685361:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788832221.685376:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537c51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685391:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537c43 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685397:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537c43 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685403:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537c43 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685409:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d3000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832221.685413:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537c43 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685420:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537c43 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685434:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d2b073ae800) 00010000:00010000:3.0:1788832221.685437:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832221.685442:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537c43 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685449:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537c43 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685463:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c4a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685469:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c4a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685486:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c4a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685492:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832221.685496:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c4a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685504:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c4a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685521:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9d2c0ad05a00) 00010000:00010000:3.0:1788832221.685524:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832221.685528:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c4a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685533:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c4a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685559:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537c51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685565:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537c51 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685570:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537c51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685575:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d3400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832221.685578:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537c51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685595:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537c51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.685606:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:3.0:1788832221.689790:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832221.689802:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537c51 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.689812:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537c51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832221.689941:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+17:12380:x1875726202654976:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 Request processed in 7525us (7950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832221.689951:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 187 00000100:00100000:1.0:1788832221.700420:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832221.701878:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202655232 00000100:00100000:2.0:1788832221.701896:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202655232 00000100:00100000:3.0:1788832221.702238:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 188 00000100:00100000:3.0:1788832221.702251:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+17:12380:x1875726202655232:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832221.702280:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832221.702307:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537c58 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc048e8 expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.702447:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.702466:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.702480:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832221.702505:0:8742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788832221.703318:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.703331:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c5f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.703338:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.703345:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832221.703350:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.703358:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.703374:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:3.0:1788832221.703378:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788832221.703384:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c5f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.703391:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537c5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.703439:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537c58 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048e8 expref: 19 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.703451:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d2b073ae800) 00010000:00010000:3.0:1788832221.703454:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788832221.703466:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537c58 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048e8 expref: 19 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.703476:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d3400, rc 0) 00000100:00100000:3.0:1788832221.703698:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+18:12380:x1875726202655232:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 1448us (3294us total) trans 4294967460 rc 301/301 00000100:00100000:3.0:1788832221.703707:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 188 00000100:00100000:0.0:1788832221.723102:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832221.723946:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202655360 00000100:00100000:2.0:1788832221.723962:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202655360 00000100:00100000:0.0:1788832221.724899:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 189 00000100:00100000:0.0:1788832221.725313:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+18:12380:x1875726202655360:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788832221.725365:0:13811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788832221.725574:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+18:12380:x1875726202655360:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 269us (2483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832221.725584:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 189 00000100:00100000:1.0:1788832221.744174:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832221.744506:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202655616 00000100:00100000:2.0:1788832221.744520:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202655616 00000100:00100000:2.0:1788832221.744593:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 190 00000100:00100000:2.0:1788832221.744605:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+18:12380:x1875726202655616:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788832221.744667:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832221.744671:0:6527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788832221.744706:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537c12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048da expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.744727:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:2.0:1788832221.744733:0:6527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788832221.744750:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537c6d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc048ef expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788832221.745312:0:6527:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788832221.745499:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537c74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.745514:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537c74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.745526:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537c74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.745593:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537c6d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048ef expref: 20 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.745664:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537c74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048ef expref: 19 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.745672:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d2c36bdb400) 00010000:00010000:2.0:1788832221.745676:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832221.745680:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031e00, rc 0) 00000100:00100000:2.0:1788832221.745769:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+19:12380:x1875726202655616:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 1165us (1610us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1788832221.745779:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 190 00000100:00100000:2.0:1788832221.752452:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832221.752513:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202655872 00000100:00100000:2.0:1788832221.752526:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202655872 00000100:00100000:2.0:1788832221.752704:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 191 00000100:00100000:2.0:1788832221.752716:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+19:12380:x1875726202655872:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788832221.752795:0:8742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832221.753047:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537c74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048ef expref: 19 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.753076:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d2c36bdb400) 00010000:00010000:2.0:1788832221.753088:0:8742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788832221.753191:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537c82 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.753210:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537c82 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.753237:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537c82 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.753254:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x6f8c7884 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.753261:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6f8c7884 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.753267:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6f8c7884 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.753401:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537c82 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.753410:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537c82 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.753416:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537c82 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.753424:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030c00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832221.753429:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537c82 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.753436:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537c82 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.753445:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:2.0:1788832221.753448:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832221.753453:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537c82 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.753466:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537c82 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.753481:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6f8c7884 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.753487:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c89 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6f8c7884 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.753492:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c89 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6f8c7884 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.753498:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832221.753502:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c89 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6f8c7884 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.753508:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c89 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6f8c7884 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.753516:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x6f8c7884 (ffff9d2c36bdbf00) 00010000:00010000:2.0:1788832221.753519:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832221.753521:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c89 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6f8c7884 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.753527:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c89 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6f8c7884 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832221.754053:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+18:12380:x1875726202655872:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 1333us (1612us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788832221.754062:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 191 00000100:00100000:2.0:1788832221.763756:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832221.764190:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202656000 00000100:00100000:2.0:1788832221.764203:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202656000 00000100:00100000:2.0:1788832221.764284:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 192 00000100:00100000:2.0:1788832221.764300:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+18:12380:x1875726202656000:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788832221.764328:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832221.764362:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c90 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc048f6 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.764409:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537c97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.764426:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537c97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.764440:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537c97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.764804:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048f6 expref: 20 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.764840:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537c97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048f6 expref: 19 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.764851:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d2c36bdbf00) 00010000:00010000:2.0:1788832221.764854:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788832221.764858:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00030c00, rc 0) 00000100:00100000:2.0:1788832221.764938:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+19:12380:x1875726202656000:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 643us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832221.764960:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 192 00000100:00100000:0.0:1788832221.773399:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832221.773689:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202656256 00000100:00100000:2.0:1788832221.773701:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202656256 00000100:00100000:2.0:1788832221.773773:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 193 00000100:00100000:2.0:1788832221.773785:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+19:12380:x1875726202656256:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788832221.773899:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c9e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.773919:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.773935:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788832221.774303:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1788832221.774317:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361814695315ns, next at 362814692324ns, rc = 0 00000004:00010000:2.0:1788832221.774385:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc6f3d48 reply state 00000000b4172ce7 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.774403:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c9e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.774412:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d2c36bdbf00) 00010000:00010000:2.0:1788832221.774415:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788832221.774421:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788832221.774563:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+21:12380:x1875726202656256:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 777us (1174us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1788832221.774572:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 193 00000100:00100000:2.0:1788832221.780819:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832221.781320:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202656384 00000100:00100000:3.0:1788832221.781343:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202656384 00000100:00100000:3.0:1788832221.781765:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 194 00000100:00100000:3.0:1788832221.781781:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+21:12380:x1875726202656384:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832221.781815:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832221.781842:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537ca5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc048fd expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.781920:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048fd expref: 22 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.781937:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048fd expref: 22 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.781957:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d2c36bdbf00) 00010000:00010000:3.0:1788832221.781961:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788832221.781965:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d3400, rc 0) 00000100:00100000:2.0:1788832221.783558:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+22:12380:x1875726202656384:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 1767us (2738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832221.783573:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 194 00000100:00100000:0.0:1788832221.790421:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832221.790596:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202656512 00000100:00100000:2.0:1788832221.790656:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202656512 00000100:00100000:2.0:1788832221.790735:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:2.0:1788832221.790748:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202656512:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788832221.791059:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:352fff76-09db-42cd-818a-16e788a01abb+7:2393:x1875726202656512:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 313us (652us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788832221.791068:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00080000:1.0:1788832221.791155:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788832221.794811:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832221.794895:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202656768 00000100:00100000:1.0:1788832221.794909:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202656768 00000100:00100000:1.0:1788832221.794984:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:1.0:1788832221.794995:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+22:12380:x1875726202656768:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788832221.795438:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+23:12380:x1875726202656768:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 442us (639us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1788832221.795446:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:0.0:1788832221.800915:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832221.801061:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202657024 00000100:00100000:2.0:1788832221.801074:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202657024 00000100:00100000:2.0:1788832221.801165:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 195 00000100:00100000:2.0:1788832221.801177:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+23:12380:x1875726202657024:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788832221.801329:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+23:12380:x1875726202657024:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 154us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832221.801339:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 195 00000100:00100000:0.0:1788832221.810974:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832221.811154:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202657152 00000100:00100000:2.0:1788832221.811168:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202657152 00000100:00100000:2.0:1788832221.811264:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 196 00000100:00100000:2.0:1788832221.811279:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+23:12380:x1875726202657152:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788832221.811308:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832221.811449:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537cac lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04904 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.811971:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537cb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.812014:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.812031:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832221.812094:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788832221.812120:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.812158:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537cac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04904 expref: 25 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.812184:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04904 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.812195:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d2c36bdbf00) 00010000:00010000:2.0:1788832221.812198:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788832221.812203:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031e00, rc 0) 00000100:00100000:0.0:1788832221.814461:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+24:12380:x1875726202657152:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 3170us (3486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832221.814476:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 196 00000100:00100000:0.0:1788832221.821955:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832221.822161:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202657280 00000100:00100000:3.0:1788832221.822175:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202657280 00000100:00100000:3.0:1788832221.822270:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:3.0:1788832221.822283:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+7:2393:x1875726202657280:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832221.822342:0:8442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832221.822374:0:8442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c485c3b6/0x998c12b283537cba lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0490b expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788832221.822407:0:8442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f69de, blocks: 0x0 00010000:00010000:3.0:1788832221.822433:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1788832221.822439:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832221.822451:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c485c3b6/0x998c12b283537cba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0490b expref: 8 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.822475:0:8442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c485c3b6/0x998c12b283537cba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0490b expref: 8 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.822505:0:8442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2200, rc 0) 00000100:00100000:3.0:1788832221.822586:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+8:2393:x1875726202657280:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 304us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832221.822594:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:2.0:1788832221.830756:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832221.830949:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202657536 00000100:00100000:0.0:1788832221.830962:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202657536 00000100:00100000:0.0:1788832221.831047:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 197 00000100:00100000:0.0:1788832221.831059:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+24:12380:x1875726202657536:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788832221.831247:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+24:12380:x1875726202657536:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 189us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832221.831278:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 197 00000100:00100000:2.0:1788832221.843084:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832221.843616:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202657664 00000100:00100000:3.0:1788832221.843655:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202657664 00000100:00100000:3.0:1788832221.843730:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 62 00000100:00100000:3.0:1788832221.843743:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+8:12380:x1875726202657664:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832221.843768:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832221.843795:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c9743b6/0x998c12b283537cc1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04912 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.843840:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c485c3b6/0x998c12b283537cba lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0490b expref: 9 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.843871:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832221.843887:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832221.843895:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c9743b6/0x998c12b283537cc1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04912 expref: 9 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.843939:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c485c3b6/0x998c12b283537cba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0490b expref: 9 pid: 8442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.843957:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c485c3b6/0x998c12b283537cba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0490b expref: 9 pid: 8442 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832221.843975:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f34e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8441:1875726218438016:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788832221.844123:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832221.847191:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832221.847378:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202657792 00000100:00100000:1.0:1788832221.847411:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202657792 00010000:00010000:1.0:1788832221.847538:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c485c3b6/0x998c12b283537cba lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0490b expref: 10 pid: 8442 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832221.847591:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 86 00000100:00100000:1.0:1788832221.847604:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+10:2393:x1875726202657792:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832221.847657:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832221.847686:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c485c3b6/0x998c12b283537cba lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0490b expref: 10 pid: 8442 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.847703:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c485c3b6/0x998c12b283537cba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0490b expref: 10 pid: 8442 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.847738:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832221.847743:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832221.847752:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c9743b6/0x998c12b283537cc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04912 expref: 10 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.847762:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c9743b6/0x998c12b283537cc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04912 expref: 10 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.847808:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007c9743b6/0x998c12b283537cc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04912 expref: 10 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832221.847825:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ec2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6510:1875726218438144:192.168.203.26@tcp:105: 00010000:00010000:3.0:1788832221.849304:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c485c3b6/0x998c12b283537cba lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0490b expref: 10 pid: 8442 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832221.849306:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c404b0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832221.850460:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f34e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8441:1875726218438016:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788832221.850517:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c9743b6/0x998c12b283537cc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04912 expref: 9 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.850539:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d3000, rc 0) 00000100:00100000:0.0:1788832221.851215:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+9:12380:x1875726202657664:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 7470us (8142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832221.851228:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 62 00000100:00100000:2.0:1788832221.854724:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ec2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6510:1875726218438144:192.168.203.26@tcp:105: 00010000:00010000:2.0:1788832221.854763:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832221.855874:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+8:2393:x1875726202657792:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 7244us (7667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832221.855898:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 86 00000100:00100000:2.0:1788832221.861516:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832221.861651:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202657920 00000100:00100000:1.0:1788832221.861664:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202657920 00002000:00100000:1.0:1788832221.861730:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9d2b07f09180 x1875726202657920/t0(0) o4->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:162/0 lens 504/0 e 0 to 0 dl 1788832232 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788832221.861743:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2b07f09180 with x1875726202657920 ext(0->8) 00002000:00010000:1.0:1788832221.861750:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d2b07f09180 00000100:00100000:1.0:1788832221.861839:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:1.0:1788832221.861864:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:352fff76-09db-42cd-818a-16e788a01abb+8:2393:x1875726202657920:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788832221.863115:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:352fff76-09db-42cd-818a-16e788a01abb+10:2393:x1875726202657920:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 Request processed in 1247us (1604us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788832221.863128:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 5 00002000:00100000:1.0:1788832221.863140:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9d2b07f09180 x1875726202657920/t4294967316(0) o4->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:162/0 lens 504/448 e 0 to 0 dl 1788832232 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788832221.863161:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2b07f09180 with x1875726202657920 ext(0->8) 00002000:00010000:1.0:1788832221.863166:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d2b07f09180 00000100:00100000:1.0:1788832221.873761:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832221.873934:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202658048 00000100:00100000:2.0:1788832221.873948:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202658048 00000100:00100000:2.0:1788832221.874035:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 198 00000100:00100000:2.0:1788832221.874048:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+24:12380:x1875726202658048:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788832221.877717:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:0.0:1788832221.877741:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788832221.877759:0:6504:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1788832221.877847:0:6557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788832221.877863:0:6557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:1.0:1788832221.878959:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c9e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.881377:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c9e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.881392:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c9e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.881400:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832221.881407:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c9e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.881443:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c9e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.881468:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d2c36bdbf00) 00010000:00010000:1.0:1788832221.881472:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788832221.881478:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c9e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.881486:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537c9e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832221.882601:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788832221.882735:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218438272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788832221.882813:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832221.882952:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+19:12380:x1875726202658048:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 Request processed in 8902us (9202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832221.882966:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 198 00000100:00100000:2.0:1788832221.883044:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218438272 00000100:00100000:2.0:1788832221.883054:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218438272 00000100:00100000:2.0:1788832221.883125:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788832221.883135:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218438272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788832221.883946:0:10097:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788832221.883953:0:10097:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788832222 00002000:00010000:2.0:1788832221.883956:0:10097:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788832221.883959:0:10097:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788832222 -> 1788832222 00002000:00010000:2.0:1788832221.883961:0:10097:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788832221.884520:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3652:x1875726218438272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1381us (1702us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788832221.884532:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788832221.884862:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788832221.885010:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d2b07f08700/2, rc 0, transno 4294967317 00000100:00100000:0.0:1788832221.885020:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218438272:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788832221.889045:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832221.889280:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202658176 00000100:00100000:3.0:1788832221.889297:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202658176 00000100:00100000:3.0:1788832221.889373:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:3.0:1788832221.889386:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+10:2394:x1875726202658176:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788832221.893188:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:3.0:1788832221.893316:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000100:00100000:0.0:1788832221.893538:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+7:2394:x1875726202658176:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 Request processed in 4146us (4501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832221.893550:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:3.0:1788832221.900173:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832221.900298:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202658432 00000100:00100000:0.0:1788832221.900313:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202658432 00000100:00100000:0.0:1788832221.900397:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 199 00000100:00100000:0.0:1788832221.900409:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+19:12380:x1875726202658432:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788832221.900487:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832221.900526:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537cb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04904 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.900561:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d2c36bdbf00) 00010000:00010000:0.0:1788832221.900567:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788832221.900836:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537cc8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.900879:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537cc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.900893:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537cc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788832221.901061:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d682471 reply state 0000000003303a87 transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537cc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.901077:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537cc8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.901084:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d2c36bdbf00) 00010000:00010000:0.0:1788832221.901086:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788832221.901089:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788832221.901232:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+20:12380:x1875726202658432:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 824us (1086us total) trans 4294967464 rc 0/0 00000100:00100000:0.0:1788832221.901240:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 199 00000100:00100000:2.0:1788832221.911167:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832221.911201:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218438400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832221.911297:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832221.911439:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218438400 00000100:00100000:0.0:1788832221.911450:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218438400 00000100:00100000:0.0:1788832221.911519:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788832221.911531:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218438400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788832221.911576:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788832221.911704:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218438400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 175us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832221.911712:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788832221.912207:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218438400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788832221.913941:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832221.914131:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202658560 00000100:00100000:0.0:1788832221.914144:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202658560 00000100:00100000:0.0:1788832221.914223:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:0.0:1788832221.914254:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+7:2393:x1875726202658560:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788832221.914495:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788832221.914499:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788832222 -> 1788832220 00002000:00010000:0.0:1788832221.914502:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788832219 00002000:00010000:0.0:1788832221.914505:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788832222 -> 1788832220 00002000:00010000:0.0:1788832221.914508:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788832221.914589:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+8:2393:x1875726202658560:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 336us (660us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788832221.914599:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:1.0:1788832221.919271:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832221.919465:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202658816 00000100:00100000:0.0:1788832221.919477:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202658816 00000100:00100000:0.0:1788832221.919700:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 200 00000100:00100000:0.0:1788832221.919712:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+20:12380:x1875726202658816:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788832221.919807:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ccf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.919826:0:8742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537c97 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048f6 expref: 20 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.919836:0:8742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ccf lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.919882:0:8742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537c97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048f6 expref: 20 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.919897:0:8742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537c97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048f6 expref: 20 pid: 13811 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832221.919939:0:8742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08577b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8742:1875726218438528:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788832221.920068:0:8742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c05388600 going to sleep for 11 seconds 00000100:00100000:2.0:1788832221.924818:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832221.925437:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202658944 00000100:00100000:3.0:1788832221.925452:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202658944 00010000:00010000:3.0:1788832221.925509:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537c97 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048f6 expref: 21 pid: 13811 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832221.925849:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 87 00000100:00100000:3.0:1788832221.925861:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c09479050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+21:2394:x1875726202658944:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832221.925880:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832221.925890:0:7466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537c97 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048f6 expref: 21 pid: 13811 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.925905:0:7466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537c97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048f6 expref: 21 pid: 13811 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.925936:0:7466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d2c36bdbf00) 00010000:00010000:3.0:1788832221.925942:0:7466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ccf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.925953:0:7466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ccf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.926082:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ccf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.926107:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832221.926340:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c09479050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+21:2394:x1875726202658944:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 480us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832221.926350:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 87 00010000:00010000:0.0:1788832221.926758:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537c97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048f6 expref: 20 pid: 13811 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832221.926784:0:8742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08577b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8742:1875726218438528:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788832221.926809:0:8742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ccf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.926819:0:8742:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ccf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.926826:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ccf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.926874:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ccf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.926881:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ccf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.926886:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ccf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.926893:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0d800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832221.926898:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ccf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.926920:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ccf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.926932:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d2c36bdbf00) 00010000:00010000:0.0:1788832221.926935:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788832221.926939:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ccf lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.926945:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ccf lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832221.927007:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+19:12380:x1875726202658816:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 Request processed in 7297us (7750us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788832221.927015:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 200 00000100:00100000:1.0:1788832221.930279:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832221.930439:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202659072 00000100:00100000:2.0:1788832221.930453:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202659072 00000100:00100000:2.0:1788832221.930578:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:2.0:1788832221.930591:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+8:2394:x1875726202659072:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788832221.930689:0:8442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b283537cd6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.930714:0:8442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007c9743b6/0x998c12b283537cc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04912 expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.930724:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832221.930728:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832221.930733:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b283537cd6 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.930780:0:8442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007c9743b6/0x998c12b283537cc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04912 expref: 8 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.930797:0:8442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007c9743b6/0x998c12b283537cc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04912 expref: 8 pid: 8441 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832221.930817:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8442:1875726218438656:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788832221.930969:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c05580780 going to sleep for 11 seconds 00000100:00100000:2.0:1788832221.934353:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8442:1875726218438656:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832221.934395:0:8442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b283537cd6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832221.935567:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832221.935889:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202659200 00000100:00100000:2.0:1788832221.935919:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202659200 00010000:00010000:2.0:1788832221.935971:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007c9743b6/0x998c12b283537cc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04912 expref: 9 pid: 8441 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832221.936018:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 88 00000100:00100000:2.0:1788832221.936030:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+9:2394:x1875726202659200:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832221.936050:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832221.936080:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007c9743b6/0x998c12b283537cc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04912 expref: 9 pid: 8441 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.936096:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007c9743b6/0x998c12b283537cc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04912 expref: 9 pid: 8441 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.936126:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c9743b6/0x998c12b283537cc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04912 expref: 9 pid: 8441 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.936150:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832221.936155:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832221.936172:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b283537cd6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.936183:0:10343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b283537cd6 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.936232:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832221.936305:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+8:2394:x1875726202659200:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 276us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832221.936333:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 88 00010000:00010000:0.0:1788832221.936398:0:8442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b283537cd6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.936409:0:8442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b283537cd6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.936434:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b283537cd6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.936442:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b283537cd6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.936450:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b283537cd6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.936465:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031e00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:0.0:1788832221.936470:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b283537cd6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.936480:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b283537cd6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.936493:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b283537cd6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.936501:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c61cb1c/0x998c12b283537cd6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832221.936555:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+7:2394:x1875726202659072:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 Request processed in 5967us (6344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832221.936563:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:1.0:1788832221.939989:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832221.940080:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202659456 00000100:00100000:2.0:1788832221.940093:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202659456 00000100:00100000:2.0:1788832221.940177:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 201 00000100:00100000:2.0:1788832221.940189:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+19:12380:x1875726202659456:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788832221.940332:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537cdd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.940351:0:13811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283537b24 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0489b expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.940362:0:13811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537cdd lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.940408:0:13811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283537b24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0489b expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.940424:0:13811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283537b24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0489b expref: 19 pid: 6526 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832221.940440:0:13811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13811:1875726218438784:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788832221.940558:0:13811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c05580780 going to sleep for 11 seconds 00000100:00100000:1.0:1788832221.944587:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832221.944763:0:13811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13811:1875726218438784:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832221.944800:0:13811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537cdd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832221.944964:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202659584 00000100:00100000:3.0:1788832221.944973:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202659584 00010000:00010000:3.0:1788832221.945022:0:6512:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283537b24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0489b expref: 20 pid: 6526 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832221.945066:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 89 00000100:00100000:3.0:1788832221.945076:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:352fff76-09db-42cd-818a-16e788a01abb+20:2394:x1875726202659584:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832221.945093:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832221.945101:0:6512:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283537b24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0489b expref: 20 pid: 6526 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.945113:0:6512:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283537b24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0489b expref: 20 pid: 6526 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.945142:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283537b24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0489b expref: 20 pid: 6526 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.945161:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:3.0:1788832221.945167:0:6512:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537cdd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.945198:0:6512:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537cdd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.945218:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537cdd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.945411:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832221.945482:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:352fff76-09db-42cd-818a-16e788a01abb+19:2394:x1875726202659584:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 406us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832221.945491:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 89 00010000:00010000:0.0:1788832221.946480:0:13811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537cdd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.946496:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537cdd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.947013:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ce4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.947033:0:13811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537ca5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048fd expref: 19 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.947050:0:13811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ce4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.947095:0:13811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048fd expref: 19 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.947111:0:13811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537ca5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048fd expref: 19 pid: 8742 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832221.947130:0:13811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08577b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13811:1875726218438912:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788832221.947806:0:13811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c05388cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832221.954450:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832221.954595:0:13811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08577b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13811:1875726218438912:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788832221.954685:0:13811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ce4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832221.954785:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202659712 00000100:00100000:2.0:1788832221.954823:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202659712 00010000:00010000:2.0:1788832221.954871:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537ca5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048fd expref: 20 pid: 8742 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832221.954921:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 90 00000100:00100000:2.0:1788832221.954931:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+20:2393:x1875726202659712:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832221.954949:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832221.954955:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537ca5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048fd expref: 20 pid: 8742 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.954966:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048fd expref: 20 pid: 8742 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.954992:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537ca5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048fd expref: 20 pid: 8742 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.955012:0:10344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d2c36bdbf00) 00010000:00010000:2.0:1788832221.955018:0:10344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ce4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.955030:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ce4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.955039:0:10344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ce4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832221.955072:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832221.955144:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+19:2393:x1875726202659712:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 213us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832221.955163:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 90 00010000:00010000:0.0:1788832221.955446:0:13811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ce4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.955455:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ce4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788832221.955603:0:13811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1788832221.955793:0:13811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:0.0:1788832221.955834:0:13811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1788832221.955958:0:13811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08577b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13811:1875726218439040:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788832221.956487:0:13811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832221.956525:0:13811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b0720d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832221.956595:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218439040 00000100:00100000:2.0:1788832221.956603:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218439040 00000100:00100000:2.0:1788832221.956908:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788832221.956918:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13811:x1875726218439040:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788832221.957094:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13811:x1875726218439040:12345-0@lo:1000:mdt00_004.0 Request processed in 177us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832221.957101:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788832221.957361:0:13811:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:1.0:1788832221.957370:0:13811:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d2b07f08700, transno 4294967317 00000100:00100000:1.0:1788832221.957393:0:13811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08577b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13811:1875726218439040:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1788832221.957554:0:13811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:1.0:1788832221.957665:0:13811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fda8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13811:1875726218439168:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788832221.957740:0:13811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832221.957770:0:13811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c404b0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832221.957779:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218439168 00000100:00100000:3.0:1788832221.957785:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218439168 00000100:00100000:3.0:1788832221.957829:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788832221.957839:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fda8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:13811:x1875726218439168:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788832221.957993:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fda8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:13811:x1875726218439168:12345-0@lo:1000:mdt00_004.0 Request processed in 156us (262us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788832221.958001:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788832221.958122:0:13811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fda8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13811:1875726218439168:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1788832221.958181:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ce4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.958193:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ce4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.958201:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ce4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.958385:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0d800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832221.958391:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ce4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.958400:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ce4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.958419:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d2c36bdbf00) 00010000:00010000:1.0:1788832221.958423:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788832221.958428:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ce4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.958434:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537ce4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.958464:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537c19 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.958471:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537c19 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.958486:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537c19 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.958491:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832221.958494:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537c19 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.958500:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537c19 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.958511:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:1.0:1788832221.958514:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788832221.958516:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537c19 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.958522:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537c19 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.958550:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537ceb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.958566:0:13811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537c35 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048e1 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.958575:0:13811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537ceb lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.958919:0:13811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537c35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048e1 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.958949:0:13811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537c35 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048e1 expref: 22 pid: 6525 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832221.958967:0:13811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fdaad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13811:1875726218439296:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788832221.959069:0:13811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c089edf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788832221.962831:0:13811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fdaad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13811:1875726218439296:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788832221.962875:0:13811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537ceb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832221.964119:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832221.964440:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202659840 00000100:00100000:0.0:1788832221.964451:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202659840 00010000:00010000:0.0:1788832221.964498:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537c35 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048e1 expref: 23 pid: 6525 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832221.964545:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 91 00000100:00100000:0.0:1788832221.964555:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+23:2394:x1875726202659840:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832221.964572:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832221.964580:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537c35 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048e1 expref: 23 pid: 6525 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.964594:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537c35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048e1 expref: 23 pid: 6525 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.964661:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537c35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc048e1 expref: 23 pid: 6525 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.964676:0:10343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:0.0:1788832221.964683:0:10343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537ceb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.964692:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537ceb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.964701:0:10343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537ceb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.964754:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832221.964831:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+22:2394:x1875726202659840:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 276us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832221.964838:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 91 00010000:00010000:1.0:1788832221.964978:0:13811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537ceb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.964987:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537ceb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.965003:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537ceb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.965010:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537ceb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.965017:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537ceb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.965023:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832221.965029:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537ceb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.965037:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537ceb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.965048:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:1.0:1788832221.965050:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832221.965064:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537ceb lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.965070:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537ceb lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.965081:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537cdd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.965088:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537cdd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.965093:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537cdd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.965099:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832221.965102:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537cdd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.965108:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537cdd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.965116:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c100ce400) 00010000:00010000:1.0:1788832221.965119:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788832221.965122:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537cdd lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832221.965128:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537cdd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832221.965331:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+21:12380:x1875726202659456:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 25143us (25356us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788832221.965342:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 201 00000020:00080000:1.0:1788832221.965352:0:13811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788832221.965766:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832221.965772:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832221.967077:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788832221.967095:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788832221.969145:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832221.969255:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202660096 00000100:00100000:3.0:1788832221.969271:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202660096 00000100:00100000:3.0:1788832221.969358:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:3.0:1788832221.969371:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18f29850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+21:12380:x1875726202660096:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788832221.969795:0:6529:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788832221.969836:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:3.0:1788832221.969879:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537cf2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.969904:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537cf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.969938:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537cf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.969947:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537cf2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.969954:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537cf2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.969961:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537cf2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832221.969992:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788832221.970070:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832221.970079:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537cf2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.970087:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2a00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:0.0:1788832221.970091:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537cf2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.970100:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537cf2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832221.970110:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18f29850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+23:12380:x1875726202660096:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 741us (980us total) trans 4294967471 rc 0/0 00010000:00010000:0.0:1788832221.970115:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d2c36bdbf00) 00000100:00100000:3.0:1788832221.970117:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 50 00010000:00010000:0.0:1788832221.970118:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788832221.970123:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537cf2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788832221.970124:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788832221.970129:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537cf2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832221.970143:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832221.970145:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832221.970147:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832222.423146:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788832222.423195:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fda9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218439424:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788832222.423366:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832222.423662:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218439424 00000100:00100000:2.0:1788832222.423684:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218439424 00000100:00100000:2.0:1788832222.423757:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788832222.423771:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218439424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788832222.423881:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788832222.423953:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218439424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 186us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832222.423961:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788832222.424129:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fda9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218439424:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788832222.679504:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832222.935744:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fdaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218439680:0@lo:400:kworker.0 00000100:00100000:2.0:1788832222.935801:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218439808:0@lo:400:kworker.0 00000100:00100000:1.0:1788832222.935813:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832222.935891:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fda9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218439552:0@lo:400:kworker.0 00000100:00100000:0.0:1788832222.936384:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218439680 00000100:00100000:0.0:1788832222.936393:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218439680 00000100:00100000:0.0:1788832222.936447:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788832222.936456:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218439680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832222.938365:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218440192:0@lo:400:kworker.0 00000100:00100000:1.0:1788832222.938417:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832222.938450:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832222.938461:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218440704:0@lo:400:kworker.0 00000100:00100000:2.0:1788832222.938482:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218440320:0@lo:400:kworker.0 00000100:00100000:1.0:1788832222.938495:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832222.938518:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832222.938542:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218440832:0@lo:400:kworker.0 00000100:00100000:1.0:1788832222.938553:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218440192 00000100:00100000:1.0:1788832222.938560:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218440192 00000100:00100000:2.0:1788832222.938565:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832222.938638:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218439808 00000100:00100000:1.0:1788832222.938641:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218439808 00000100:00100000:1.0:1788832222.938661:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218440704 00000100:00100000:1.0:1788832222.938664:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218440704 00000100:00100000:2.0:1788832222.938678:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788832222.938689:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788832222.938693:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218440192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832222.938701:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218439808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832222.938779:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218440192:12345-0@lo:400:kworker.0 Request processed in 84us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832222.938780:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218439808:12345-0@lo:400:kworker.0 Request processed in 79us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832222.938795:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788832222.939985:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832222.940048:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218440064:0@lo:400:kworker.0 00000100:00100000:3.0:1788832222.940085:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832222.940098:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1875726218440576:0@lo:400:kworker.0 00000100:00100000:3.0:1788832222.940120:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832222.940140:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218441088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832222.940178:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832222.940202:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788832222.940209:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218439936:0@lo:400:kworker.0 00000100:00100000:3.0:1788832222.940261:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832222.940285:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218440448:0@lo:400:kworker.0 00000100:00100000:3.0:1788832222.940325:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832222.940505:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218440960:0@lo:400:kworker.0 00000100:00100000:3.0:1788832222.940528:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832222.940566:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218439552 00000100:00100000:3.0:1788832222.940572:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218439552 00000100:00100000:3.0:1788832222.940648:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1788832222.940657:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3654:x1875726218439552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832222.940706:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3654:x1875726218439552:12345-0@lo:400:kworker.0 Request processed in 50us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832222.940713:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1788832222.940746:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218441088 00000100:00100000:3.0:1788832222.940750:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218441088 00000100:00100000:3.0:1788832222.940776:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788832222.940783:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1875726218441088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788832222.940804:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832222.941060:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1875726218441088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 276us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832222.941067:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788832222.941091:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218439936 00000100:00100000:3.0:1788832222.941095:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218439936 00000100:00100000:3.0:1788832222.941123:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788832222.941129:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218439936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832222.941733:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218439936:12345-0@lo:400:kworker.0 Request processed in 602us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832222.941754:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788832222.941780:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218440320 00000100:00100000:3.0:1788832222.941784:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218440320 00000100:00100000:3.0:1788832222.942547:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218440832 00000100:00100000:3.0:1788832222.942555:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218440832 00000100:00100000:3.0:1788832222.942578:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218440448 00000100:00100000:3.0:1788832222.942581:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218440448 00000100:00100000:3.0:1788832222.942592:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218440960 00000100:00100000:3.0:1788832222.942595:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218440960 00000100:00100000:3.0:1788832222.942647:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788832222.942656:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218440320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832222.942718:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07755c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218440320:12345-0@lo:400:kworker.0 Request processed in 63us (4199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832222.942724:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788832222.942739:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788832222.942745:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218440832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832222.942775:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218440832:12345-0@lo:400:kworker.0 Request processed in 31us (4210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832222.942781:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788832222.942794:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788832222.942799:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3654:x1875726218440448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832222.943502:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788832222.943580:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218440064 00000100:00100000:1.0:1788832222.943586:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218440064 00000100:00100000:1.0:1788832222.943616:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218440576 00000100:00100000:1.0:1788832222.943767:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218440576 00000100:00100000:1.0:1788832222.943792:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788832222.943800:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875726218440704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832222.943902:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788832222.943920:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3654:x1875726218440960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832222.944287:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788832222.944300:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218440064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832222.944501:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875726218440704:12345-0@lo:400:kworker.0 Request processed in 702us (6006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832222.944522:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788832222.944539:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788832222.944546:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875726218440576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832222.944580:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1875726218440576:12345-0@lo:400:kworker.0 Request processed in 35us (4459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832222.944585:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00080000:1.0:1788832222.944632:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788832222.944638:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788832222.944640:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788832222.944643:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788832222.944687:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218439808:0@lo:400:kworker.0 00000100:00100000:1.0:1788832222.944702:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218440320:0@lo:400:kworker.0 00000100:00100000:1.0:1788832222.944717:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218440832:0@lo:400:kworker.0 00010000:00080000:1.0:1788832222.944765:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0857f480 x1875726218440192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832222.944776:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218440192:0@lo:400:kworker.0 00010000:00080000:1.0:1788832222.944787:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0857c380 x1875726218440704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832222.944797:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218440704:0@lo:400:kworker.0 00000100:00100000:1.0:1788832222.944870:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218439680:12345-0@lo:400:kworker.0 Request processed in 8415us (9057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832222.944877:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788832222.944982:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218440064:12345-0@lo:400:kworker.0 Request processed in 686us (4895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832222.944990:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788832222.945073:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fdaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218439680:0@lo:400:kworker.0 00000100:00100000:2.0:1788832222.945087:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218439936:0@lo:400:kworker.0 00000100:00100000:2.0:1788832222.945125:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218441088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832222.945141:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fda9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218439552:0@lo:400:kworker.0 00000100:00100000:2.0:1788832222.945155:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218440064:0@lo:400:kworker.0 00000100:00100000:2.0:1788832222.945170:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1875726218440576:0@lo:400:kworker.0 00000100:00100000:3.0:1788832222.945468:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3654:x1875726218440448:12345-0@lo:400:kworker.0 Request processed in 2667us (5140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832222.945473:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3654:x1875726218440960:12345-0@lo:400:kworker.0 Request processed in 1556us (4944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832222.945476:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788832222.945480:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788832222.946035:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218440448:0@lo:400:kworker.0 00000100:00100000:1.0:1788832222.946047:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218440960:0@lo:400:kworker.0 00000100:00100000:2.0:1788832223.447856:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218441216:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788832223.447929:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832223.448000:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218441216 00000100:00100000:2.0:1788832223.448007:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218441216 00000100:00100000:2.0:1788832223.448050:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788832223.448059:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218441216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788832223.448084:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788832223.448130:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218441216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832223.448137:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788832223.448191:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07df6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218441216:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1788832223.546823:0:14762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788832223.546833:0:14762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788832223.546859:0:14762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788832223.546874:0:14762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788832223.704500:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832223.716308:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832223.716348:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202660352 00000100:00100000:2.0:1788832223.716358:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202660352 00000100:00100000:2.0:1788832223.716422:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 202 00000100:00100000:2.0:1788832223.716434:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+23:12398:x1875726202660352:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788832223.717234:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832223.717260:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537cf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04919 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832223.717372:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537d00 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832223.717387:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537d00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832223.717399:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537d00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832223.717411:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788832223.717790:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537cf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04919 expref: 26 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832223.717809:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537d00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04919 expref: 25 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832223.717817:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:2.0:1788832223.717820:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788832223.717823:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031c00, rc 0) 00000100:00100000:2.0:1788832223.719802:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+25:12398:x1875726202660352:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 3361us (3494us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788832223.719813:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 202 00000100:00080000:2.0:1788832223.719852:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832223.736535:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832223.737331:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202660480 00000100:00100000:0.0:1788832223.737341:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202660480 00000100:00100000:0.0:1788832223.737398:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 203 00000100:00100000:0.0:1788832223.737409:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+25:12398:x1875726202660480:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:0.0:1788832223.737485:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537d0e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.737504:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537d0e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.737516:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537d0e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.737530:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.737536:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.737554:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.737653:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537d1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.737853:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537d1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.737861:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537d1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788832223.737906:0:8742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537d1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.737918:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537d0e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.737923:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537d0e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.737929:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537d0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.737934:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832223.737938:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537d0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.737945:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537d0e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.737956:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:0.0:1788832223.737964:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832223.737969:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537d0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.737974:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537d0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.737985:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.737992:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.737998:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.738003:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0d600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832223.738006:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.738012:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.738019:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2c39194500) 00010000:00010000:0.0:1788832223.738022:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832223.738025:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.738031:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.738045:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537d1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.738057:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537d1c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.738063:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537d1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.738068:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0d200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832223.738071:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537d1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.738078:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537d1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.738085:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2c39194b00) 00010000:00010000:0.0:1788832223.738088:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832223.738091:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537d1c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.738096:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537d1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832223.738184:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+25:12398:x1875726202660480:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 775us (1657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832223.738192:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 203 00000100:00100000:3.0:1788832223.846704:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832223.846967:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202660736 00000100:00100000:1.0:1788832223.846983:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202660736 00000100:00100000:1.0:1788832223.847048:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 204 00000100:00100000:1.0:1788832223.847060:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+25:12401:x1875726202660736:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788832223.847083:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832223.847102:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537d23 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04920 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847173:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537d2a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847188:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537d2a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847200:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537d2a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847225:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847233:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847240:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847386:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537d38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847395:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537d38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847402:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537d38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832223.847412:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788832223.847490:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537d2a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847498:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537d2a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847505:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537d2a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847511:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832223.847517:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537d2a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847524:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537d2a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847536:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:1.0:1788832223.847539:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832223.847543:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537d2a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847560:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537d2a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847574:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847580:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d31 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847586:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847591:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832223.847604:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847610:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d31 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847800:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2b073ad400) 00010000:00010000:1.0:1788832223.847804:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832223.847808:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d31 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847814:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847860:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537d23 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04920 expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847873:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537d38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04920 expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.847887:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2b073ad700) 00010000:00010000:1.0:1788832223.847889:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832223.847892:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cff400, rc 0) 00000100:00100000:1.0:1788832223.847965:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+27:12401:x1875726202660736:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 907us (1269us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1788832223.847973:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 204 00000100:00100000:3.0:1788832223.851759:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832223.851809:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202660864 00000100:00100000:1.0:1788832223.851820:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202660864 00000100:00100000:1.0:1788832223.851884:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 205 00000100:00100000:1.0:1788832223.851897:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+27:12401:x1875726202660864:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:1.0:1788832223.851965:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537d46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.851981:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537d46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.851993:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537d46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.852029:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537d46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.852036:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537d46 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.852043:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537d46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.852049:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfee00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832223.852068:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537d46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.852077:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537d46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.852089:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2b073ad700) 00010000:00010000:1.0:1788832223.852092:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788832223.852096:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537d46 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.852102:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537d46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832223.852315:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+27:12401:x1875726202660864:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 419us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832223.852324:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 205 00000100:00100000:3.0:1788832223.859368:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832223.865077:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202661120 00000100:00100000:2.0:1788832223.865093:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202661120 00000100:00100000:2.0:1788832223.867768:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:2.0:1788832223.867783:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+27:12401:x1875726202661120:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:2.0:1788832223.868032:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+28:12401:x1875726202661120:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 252us (8725us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1788832223.868040:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:2.0:1788832223.904706:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832223.905058:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202661376 00000100:00100000:0.0:1788832223.905069:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202661376 00000100:00100000:0.0:1788832223.905218:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 206 00000100:00100000:0.0:1788832223.905229:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+28:11925:x1875726202661376:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1788832223.905254:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832223.905284:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537d4d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04927 expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.905520:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d54 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.905535:0:8742:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537d38 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04920 expref: 29 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.905543:0:8742:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d54 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.905576:0:8742:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537d38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04920 expref: 29 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.905591:0:8742:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537d38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04920 expref: 29 pid: 6525 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832223.905616:0:8742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08577800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8742:1875726218441344:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788832223.905874:0:8742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b0720d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832223.908913:0:8742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08577800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8742:1875726218441344:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788832223.908941:0:8742:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d54 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832223.911039:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832223.911800:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202661504 00000100:00100000:1.0:1788832223.911811:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202661504 00010000:00010000:0.0:1788832223.911940:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537d38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04920 expref: 30 pid: 6525 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832223.912023:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 92 00000100:00100000:0.0:1788832223.912034:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+30:2394:x1875726202661504:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832223.912064:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832223.912072:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537d38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04920 expref: 30 pid: 6525 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.912086:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537d38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04920 expref: 30 pid: 6525 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.912108:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537d38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04920 expref: 30 pid: 6525 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.916489:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2b073ad700) 00010000:00010000:0.0:1788832223.916502:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d54 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.916516:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.916525:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d54 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.916570:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832223.916907:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+29:2394:x1875726202661504:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 4869us (5871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832223.916919:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 92 00010000:00010000:1.0:1788832223.917324:0:8742:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.917334:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d54 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832223.917354:0:8742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788832223.917483:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537d4d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04927 expref: 30 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.917500:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d54 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04927 expref: 29 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.917527:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2b073ad700) 00010000:00010000:1.0:1788832223.917530:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788832223.917532:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0d600, rc 0) 00000100:00100000:1.0:1788832223.917644:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+29:11925:x1875726202661376:12345-192.168.203.26@tcp:101:bash.0 Request processed in 12416us (12947us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1788832223.917651:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 206 00000100:00100000:2.0:1788832223.921787:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832223.922497:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202661632 00000100:00100000:1.0:1788832223.922509:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202661632 00000100:00100000:1.0:1788832223.922571:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 207 00000100:00100000:1.0:1788832223.922580:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+29:11925:x1875726202661632:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1788832223.922613:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832223.922754:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537d62 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0492e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.922790:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537d69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.922804:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537d69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.922814:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537d69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.922924:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537d62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0492e expref: 31 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.922942:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537d69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0492e expref: 30 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.922957:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2b073ad700) 00010000:00010000:1.0:1788832223.922960:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788832223.922964:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfec00, rc 0) 00000100:00100000:1.0:1788832223.923027:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+30:11925:x1875726202661632:12345-192.168.203.26@tcp:101:bash.0 Request processed in 447us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832223.923034:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 207 00000100:00100000:2.0:1788832223.926890:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832223.930218:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202661888 00000100:00100000:1.0:1788832223.930233:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202661888 00000100:00100000:1.0:1788832223.930305:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 208 00000100:00100000:1.0:1788832223.930323:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+30:11925:x1875726202661888:12345-192.168.203.26@tcp:36:bash.0 00010000:00010000:1.0:1788832223.930906:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d70 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.930925:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.930938:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788832223.930983:0:13811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:1.0:1788832223.931007:0:13811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030f88499 reply state 00000000b7445fbf transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.931019:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.931026:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2b073ad700) 00010000:00010000:1.0:1788832223.931028:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788832223.931178:0:13811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788832223.931690:0:13811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:1.0:1788832223.931791:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+34:11925:x1875726202661888:12345-192.168.203.26@tcp:36:bash.0 Request processed in 1467us (4907us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788832223.931799:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 208 00000020:00080000:1.0:1788832223.931803:0:13811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788832223.941155:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832223.941357:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202662016 00000100:00100000:1.0:1788832223.941367:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202662016 00000100:00100000:1.0:1788832223.941430:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 209 00000100:00100000:1.0:1788832223.941440:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+34:11925:x1875726202662016:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1788832223.941464:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832223.941484:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537d77 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04935 expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.941539:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537d77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04935 expref: 35 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.941555:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537d77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04935 expref: 35 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832223.941573:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2b073ad700) 00010000:00010000:1.0:1788832223.941576:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788832223.941581:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfee00, rc 0) 00000100:00100000:1.0:1788832223.941690:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+35:11925:x1875726202662016:12345-192.168.203.26@tcp:101:bash.0 Request processed in 250us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832223.941698:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 209 00000100:00100000:2.0:1788832223.949018:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832223.949444:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202662144 00000100:00100000:0.0:1788832223.949455:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202662144 00000100:00100000:0.0:1788832223.949534:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:0.0:1788832223.949546:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:352fff76-09db-42cd-818a-16e788a01abb+7:11925:x1875726202662144:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1788832223.949580:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832223.949611:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c238400f/0x998c12b283537d7e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0493c expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788832223.949671:0:10099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f69dc, atime: 0x6a9f69db, ctime: 0x6a9f69dc, blocks: 0x8 00010000:00010000:0.0:1788832223.949693:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=363s v=(0 0) 00010000:00010000:0.0:1788832223.949698:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832223.949707:0:10099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c238400f/0x998c12b283537d7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0493c expref: 8 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.949722:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c238400f/0x998c12b283537d7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0493c expref: 8 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832223.949735:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0d400, rc 0) 00000100:00100000:0.0:1788832223.949789:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:352fff76-09db-42cd-818a-16e788a01abb+8:11925:x1875726202662144:12345-192.168.203.26@tcp:101:bash.0 Request processed in 246us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832223.949796:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00080000:2.0:1788832223.953416:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788832223.957970:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832223.958041:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202662272 00000100:00100000:3.0:1788832223.958050:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202662272 00002000:00010000:3.0:1788832223.958094:0:8446:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1788832223.958099:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2b08577800 with x1875726202662272 ext(0->18446744073709551615) 00002000:00010000:3.0:1788832223.958113:0:8446:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d2b08577800. 00000100:00100000:3.0:1788832223.958150:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:3.0:1788832223.958160:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:352fff76-09db-42cd-818a-16e788a01abb+8:2394:x1875726202662272:12345-192.168.203.26@tcp:10:bash.0 00002000:00010000:3.0:1788832223.959719:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788832223.959728:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788832220 -> 1788832224 00002000:00010000:3.0:1788832223.959732:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788832219 -> 1788832219 00002000:00010000:3.0:1788832223.959734:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788832220 -> 1788832224 00002000:00010000:3.0:1788832223.959736:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1788832223.959857:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:352fff76-09db-42cd-818a-16e788a01abb+9:2394:x1875726202662272:12345-192.168.203.26@tcp:10:bash.0 Request processed in 1694us (1891us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788832223.959868:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 6 00002000:00010000:3.0:1788832223.959873:0:8446:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1788832223.959876:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2b08577800 with x1875726202662272 ext(0->18446744073709551615) 00002000:00010000:3.0:1788832223.959883:0:8446:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d2b08577800. 00000100:00100000:1.0:1788832223.960449:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218441472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788832223.960498:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832223.960747:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218441472 00000100:00100000:2.0:1788832223.960754:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218441472 00000100:00100000:2.0:1788832223.960814:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788832223.960823:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218441472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788832223.960850:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788832223.960891:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218441472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832223.960897:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788832223.960946:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218441472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788832224.043718:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832224.044099:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202662400 00000100:00100000:1.0:1788832224.044109:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202662400 00000100:00100000:1.0:1788832224.044177:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 210 00000100:00100000:1.0:1788832224.044188:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+35:12415:x1875726202662400:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:1.0:1788832224.044265:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537d85 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044284:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537d85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044297:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537d85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044312:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537d8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044319:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537d8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044325:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537d8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044395:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537d93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044404:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537d93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044411:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537d93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788832224.044455:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537d93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044478:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537d85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044484:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537d85 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044491:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537d85 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044497:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832224.044501:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537d85 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044509:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537d85 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044533:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:1.0:1788832224.044537:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832224.044540:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537d85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044546:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537d85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044557:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537d8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044563:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537d8c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044568:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537d8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044578:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832224.044581:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537d8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044586:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537d8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044603:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2b073ad400) 00010000:00010000:1.0:1788832224.044606:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832224.044609:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537d8c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044614:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537d8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044674:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537d93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044681:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537d93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044687:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537d93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044692:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832224.044695:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537d93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044701:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537d93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044719:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2b073ad700) 00010000:00010000:1.0:1788832224.044721:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832224.044724:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537d93 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.044730:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe200/0x998c12b283537d93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832224.044816:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+35:12415:x1875726202662400:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 629us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832224.044824:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 210 00000100:00100000:2.0:1788832224.107724:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832224.107835:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202662656 00000100:00100000:0.0:1788832224.107845:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202662656 00000100:00100000:0.0:1788832224.107914:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 211 00000100:00100000:0.0:1788832224.107925:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+35:12418:x1875726202662656:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788832224.107949:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832224.107970:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b283537d9a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04943 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108064:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537da1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108079:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537da1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108090:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537da1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108104:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537da8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108110:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537da8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108115:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537da8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108221:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b283537daf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108231:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b283537daf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108238:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b283537daf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832224.108246:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788832224.108329:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537da1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108336:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537da1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108350:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537da1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108356:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832224.108360:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537da1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108367:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537da1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108379:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:0.0:1788832224.108382:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832224.108386:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537da1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108392:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537da1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108405:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537da8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108411:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537da8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108416:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537da8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108421:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0d200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832224.108423:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537da8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108440:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537da8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108449:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2c39194a00) 00010000:00010000:0.0:1788832224.108450:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832224.108453:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537da8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108458:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537da8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108497:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b283537d9a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04943 expref: 38 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108512:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b283537daf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04943 expref: 37 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.108532:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2b073ad700) 00010000:00010000:0.0:1788832224.108535:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788832224.108537:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0ce00, rc 0) 00000100:00100000:0.0:1788832224.108607:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+37:12418:x1875726202662656:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 683us (893us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788832224.108615:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 211 00000100:00100000:3.0:1788832224.117098:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832224.117259:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202662784 00000100:00100000:2.0:1788832224.117268:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202662784 00000100:00100000:2.0:1788832224.117332:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 212 00000100:00100000:2.0:1788832224.117342:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+37:12418:x1875726202662784:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:2.0:1788832224.117419:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.117436:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d54 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04927 expref: 37 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.117444:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dbd lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.117478:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d54 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04927 expref: 37 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.117491:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d54 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04927 expref: 37 pid: 8742 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832224.117504:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1875726218441600:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788832224.117614:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c05580540 going to sleep for 11 seconds 00000100:00100000:3.0:1788832224.122047:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832224.122128:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202663040 00000100:00100000:0.0:1788832224.122140:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202663040 00000100:00100000:2.0:1788832224.122194:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1875726218441600:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788832224.122205:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:0.0:1788832224.122217:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+38:6637:x1875726202663040:12345-192.168.203.26@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1788832224.122460:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832224.122514:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+39:6637:x1875726202663040:12345-192.168.203.26@tcp:35:ldlm_bl.0 Request processed in 298us (475us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788832224.122523:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:0.0:1788832224.126048:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832224.126444:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202663168 00000100:00100000:3.0:1788832224.126469:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202663168 00010000:00010000:3.0:1788832224.126510:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d54 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04927 expref: 39 pid: 8742 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832224.126804:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 93 00000100:00100000:3.0:1788832224.126816:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08574e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+39:2393:x1875726202663168:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832224.126835:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832224.126843:0:7466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d54 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04927 expref: 39 pid: 8742 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832224.126858:0:7466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d54 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04927 expref: 39 pid: 8742 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832224.126896:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537d54 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04927 expref: 39 pid: 8742 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832224.126923:0:7466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2b073ad700) 00010000:00010000:3.0:1788832224.126928:0:7466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832224.126939:0:7466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832224.126947:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dbd lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832224.126984:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832224.127048:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08574e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+38:2393:x1875726202663168:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 234us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832224.127067:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 93 00010000:00010000:0.0:1788832224.127148:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.127157:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.127216:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.127224:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dbd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.127231:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.127238:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030c00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832224.127243:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.127251:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dbd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.127262:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2b073ad700) 00010000:00010000:0.0:1788832224.127265:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788832224.127269:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dbd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.127286:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832224.127359:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+37:12418:x1875726202662784:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 10017us (10270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832224.127367:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 212 00000100:00100000:0.0:1788832224.133491:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832224.133841:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202663424 00000100:00100000:1.0:1788832224.133853:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202663424 00000100:00100000:1.0:1788832224.134074:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:1.0:1788832224.134088:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+37:12418:x1875726202663424:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1788832224.134717:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+38:12418:x1875726202663424:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 629us (1231us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788832224.134726:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:1.0:1788832224.232471:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832224.232570:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202663680 00000100:00100000:2.0:1788832224.232604:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202663680 00000100:00100000:2.0:1788832224.232710:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 213 00000100:00100000:2.0:1788832224.232721:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+38:12429:x1875726202663680:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:2.0:1788832224.232748:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832224.232767:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537dc4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0494a expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.232841:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537dcb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.232855:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537dcb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.232867:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537dcb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.232882:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dd2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.232889:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.232896:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.233017:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537dd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.233026:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.233033:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832224.233050:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788832224.233126:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537dcb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.233133:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537dcb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.233139:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537dcb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.233145:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832224.233149:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537dcb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.233157:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537dcb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.233169:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:2.0:1788832224.233172:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832224.233176:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537dcb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.233182:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537dcb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.233198:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.233442:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dd2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.233459:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.233464:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030c00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832224.233467:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.233474:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dd2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.233483:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2c36bdb800) 00010000:00010000:2.0:1788832224.233486:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832224.233489:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dd2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.233494:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537dd2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.233534:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537dc4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0494a expref: 41 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.233549:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0494a expref: 40 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.233558:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2b073ad700) 00010000:00010000:2.0:1788832224.233560:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832224.233563:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031600, rc 0) 00000100:00100000:2.0:1788832224.233689:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+40:12429:x1875726202663680:12345-192.168.203.26@tcp:101:cat.0 Request processed in 969us (1226us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788832224.233707:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 213 00000100:00100000:3.0:1788832224.237178:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832224.237572:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202663936 00000100:00100000:0.0:1788832224.237583:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202663936 00000100:00100000:0.0:1788832224.237978:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:0.0:1788832224.237990:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+40:12429:x1875726202663936:12345-192.168.203.26@tcp:35:cat.0 00000100:00100000:0.0:1788832224.238300:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+41:12429:x1875726202663936:12345-192.168.203.26@tcp:35:cat.0 Request processed in 312us (1131us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788832224.238445:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:3.0:1788832224.273119:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832224.273258:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202664192 00000100:00100000:1.0:1788832224.273268:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202664192 00000100:00100000:1.0:1788832224.273386:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 214 00000100:00100000:1.0:1788832224.273409:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+41:12430:x1875726202664192:12345-192.168.203.26@tcp:36:rm.0 00010000:00010000:1.0:1788832224.274352:0:8742:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788832224.274393:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537d77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04935 expref: 41 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.274439:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537dd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0494a expref: 40 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.274455:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b283537daf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04943 expref: 39 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.274466:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537d69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0492e expref: 38 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.274476:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2b073ad700) 00010000:00010000:1.0:1788832224.274481:0:8742:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788832224.274511:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537de7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.274522:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537de7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.274543:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537de7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.274558:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537dee lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.274564:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537dee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.274570:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537dee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.274703:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537df5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.274712:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537df5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.274747:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537df5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788832224.274968:0:8742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1788832224.274978:0:8742:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 364315356951ns, next at 365315354414ns, rc = 0 00010000:00010000:1.0:1788832224.275024:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537dfc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.275398:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537dfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.275409:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537dfc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.275417:0:8742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537dfc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.275423:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537dfc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.275430:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537dfc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.275453:0:8742:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788832224.275473:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537df5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.275476:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832224.275484:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537dfc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.275488:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537df5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.275493:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537df5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.275494:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff600 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:1.0:1788832224.275498:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832224.275498:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537dfc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.275502:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537df5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.275506:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537dfc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.275507:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537df5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.275519:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2b073ad700) 00010000:00010000:0.0:1788832224.275522:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788832224.275530:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537dfc lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.275531:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2b073ad700) 00010000:00010000:1.0:1788832224.275534:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788832224.275536:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537df5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.275537:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537dfc lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.275542:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537df5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.275550:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832224.275551:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832224.275553:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832224.275556:0:8742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537de7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.275561:0:8742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537de7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.275567:0:8742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537de7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.275572:0:8742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832224.275583:0:8742:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537de7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.275588:0:8742:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537de7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.275606:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:1.0:1788832224.275608:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832224.275611:0:8742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537de7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.275616:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537de7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788832224.275655:0:8742:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000005aec37 reply state 000000000b238465 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537dee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.275666:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537dee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.275672:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2b073ad400) 00010000:00010000:1.0:1788832224.275675:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788832224.275678:0:8742:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788832224.275761:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+39:12430:x1875726202664192:12345-192.168.203.26@tcp:36:rm.0 Request processed in 2352us (2649us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788832224.275769:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 214 00000100:00100000:3.0:1788832224.327542:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832224.327664:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202664448 00000100:00100000:0.0:1788832224.327675:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202664448 00000100:00100000:0.0:1788832224.327742:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 215 00000100:00100000:0.0:1788832224.327752:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+39:12436:x1875726202664448:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1788832224.327777:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832224.327797:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537e03 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04951 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.327919:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537e0a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.327932:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537e0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.327942:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537e0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.327952:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537e11 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.327959:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537e11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.327997:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537e11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788832224.328299:0:6527:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788832224.328704:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537e18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.328716:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537e18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.328724:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537e18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.328759:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537e0a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.328766:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537e0a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.328773:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537e0a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.328779:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832224.328784:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537e0a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.328791:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537e0a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.328804:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:0.0:1788832224.328807:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832224.328820:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537e0a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.328827:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537e0a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788832224.328852:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004029ade4 reply state 00000000e85d54c3 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537e11 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.328864:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537e11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.328871:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2b073ad400) 00010000:00010000:0.0:1788832224.328873:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788832224.328876:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788832224.328905:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537e03 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04951 expref: 42 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.328920:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537e18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04951 expref: 41 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.328927:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2c39194a00) 00010000:00010000:0.0:1788832224.328930:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788832224.328932:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0d800, rc 0) 00000100:00100000:0.0:1788832224.329010:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+42:12436:x1875726202664448:12345-192.168.203.26@tcp:101:bash.0 Request processed in 1259us (1484us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788832224.329018:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 215 00000100:00100000:3.0:1788832224.332062:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832224.332157:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202664576 00000100:00100000:0.0:1788832224.332167:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202664576 00000100:00100000:0.0:1788832224.332251:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:0.0:1788832224.332261:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+7:2393:x1875726202664576:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1788832224.332292:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832224.332311:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daef9094/0x998c12b283537e26 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04958 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788832224.332336:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788832224.332355:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=364s v=(0 0) 00010000:00010000:0.0:1788832224.332360:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832224.332368:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daef9094/0x998c12b283537e26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04958 expref: 8 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.332388:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000daef9094/0x998c12b283537e26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04958 expref: 8 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.332401:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0c200, rc 0) 00000100:00100000:0.0:1788832224.332458:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+8:2393:x1875726202664576:12345-192.168.203.26@tcp:101:bash.0 Request processed in 199us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832224.332466:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00080000:2.0:1788832224.335026:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788832224.337819:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832224.338036:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202664704 00000100:00100000:2.0:1788832224.338046:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202664704 00000100:00100000:2.0:1788832224.338104:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:2.0:1788832224.338114:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+8:12436:x1875726202664704:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:2.0:1788832224.338132:0:10097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832224.338151:0:10097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283537e2d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0495f expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.338181:0:10097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000daef9094/0x998c12b283537e26 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04958 expref: 9 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.338191:0:10097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832224.338207:0:10097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832224.338213:0:10097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283537e2d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0495f expref: 9 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.338249:0:10097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000daef9094/0x998c12b283537e26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04958 expref: 9 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.338274:0:10097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000daef9094/0x998c12b283537e26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04958 expref: 9 pid: 8441 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832224.338290:0:10097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10097:1875726218441728:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788832224.338398:0:10097:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c05580cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832224.341221:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832224.341704:0:10097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10097:1875726218441728:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832224.341740:0:10097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283537e2d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0495f expref: 9 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.341760:0:10097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031e00, rc 0) 00000100:00100000:2.0:1788832224.341817:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+9:12436:x1875726202664704:12345-192.168.203.26@tcp:101:bash.0 Request processed in 3704us (4007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832224.341825:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:0.0:1788832224.344327:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202664832 00000100:00100000:0.0:1788832224.344341:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202664832 00010000:00010000:0.0:1788832224.344391:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000daef9094/0x998c12b283537e26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04958 expref: 9 pid: 8441 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832224.344449:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 94 00000100:00100000:0.0:1788832224.344460:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c0947b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+9:2393:x1875726202664832:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832224.344475:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832224.344511:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000daef9094/0x998c12b283537e26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04958 expref: 9 pid: 8441 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.344526:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000daef9094/0x998c12b283537e26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04958 expref: 9 pid: 8441 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.344552:0:10343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daef9094/0x998c12b283537e26 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04958 expref: 9 pid: 8441 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.344570:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832224.344575:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832224.344584:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283537e2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0495f expref: 8 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.344607:0:10343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283537e2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0495f expref: 8 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.344668:0:10343:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283537e2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0495f expref: 8 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832224.344682:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08576300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10343:1875726218441856:192.168.203.26@tcp:105: 00000100:00100000:0.0:1788832224.344766:0:10343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b0720da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832224.348407:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832224.348894:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202665088 00000100:00100000:1.0:1788832224.348904:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202665088 00000100:00100000:1.0:1788832224.348950:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:1.0:1788832224.348958:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+42:12436:x1875726202665088:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:1.0:1788832224.349366:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+43:12436:x1875726202665088:12345-192.168.203.26@tcp:35:bash.0 Request processed in 407us (966us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1788832224.349386:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:2.0:1788832224.351708:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08576300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10343:1875726218441856:192.168.203.26@tcp:105: 00010000:00010000:2.0:1788832224.351735:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832224.351799:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c0947b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+8:2393:x1875726202664832:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 7340us (10587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832224.351811:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 94 00000100:00100000:2.0:1788832224.472511:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218441984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832224.472598:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832224.472864:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218441984 00000100:00100000:0.0:1788832224.472874:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218441984 00000100:00100000:0.0:1788832224.472942:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788832224.472952:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875726218441984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788832224.472989:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923525632 avail 3692003328 00000100:00080000:2.0:1788832224.473006:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788832224.473064:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1875726218441984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832224.473070:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788832224.473150:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218441984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788832224.544089:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832224.544202:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202665216 00000100:00100000:1.0:1788832224.544212:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202665216 00000100:00100000:1.0:1788832224.544283:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 216 00000100:00100000:1.0:1788832224.544293:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+43:12452:x1875726202665216:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788832224.544327:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832224.544348:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537e34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04966 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.544408:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537e3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.544422:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.544434:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832224.544473:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788832224.544477:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788832224.544495:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537e3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.544517:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537e34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04966 expref: 45 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.544543:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537e3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04966 expref: 44 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.544571:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:1.0:1788832224.544574:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788832224.544577:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe600, rc 0) 00000100:00100000:1.0:1788832224.544834:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+44:12452:x1875726202665216:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 541us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832224.544842:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 216 00000100:00100000:0.0:1788832224.551268:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832224.551471:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202665472 00000100:00100000:1.0:1788832224.551482:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202665472 00000100:00100000:1.0:1788832224.551537:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 217 00000100:00100000:1.0:1788832224.551548:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+44:12452:x1875726202665472:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788832224.551571:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832224.551600:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537e42 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0496d expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.551727:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537e49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.551741:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537e49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.551752:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537e49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832224.551762:0:8742:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788832224.551856:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537e42 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0496d expref: 47 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.551890:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537e49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0496d expref: 46 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.551899:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2c39194a00) 00010000:00010000:1.0:1788832224.551902:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832224.551906:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfec00, rc 0) 00000100:00100000:1.0:1788832224.551971:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+46:12452:x1875726202665472:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 424us (712us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1788832224.551980:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 217 00000100:00100000:3.0:1788832224.558213:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832224.558540:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202665728 00000100:00100000:2.0:1788832224.558663:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202665728 00000100:00100000:2.0:1788832224.558733:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 218 00000100:00100000:2.0:1788832224.558744:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+46:12452:x1875726202665728:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788832224.558769:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832224.558789:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537e57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04974 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.558991:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537e5e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.559007:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537e5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.559019:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537e5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832224.559031:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788832224.559141:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537e57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04974 expref: 49 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.559163:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537e5e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04974 expref: 48 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.559171:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2c39194a00) 00010000:00010000:2.0:1788832224.559174:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788832224.559178:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00030600, rc 0) 00000100:00100000:2.0:1788832224.559308:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+48:12452:x1875726202665728:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 565us (1103us total) trans 4294967488 rc 0/0 00000100:00100000:2.0:1788832224.559316:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 218 00000100:00100000:3.0:1788832224.562757:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832224.563537:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202665856 00000100:00100000:2.0:1788832224.563547:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202665856 00000100:00100000:2.0:1788832224.563653:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:2.0:1788832224.563666:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:352fff76-09db-42cd-818a-16e788a01abb+48:2395:x1875726202665856:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832224.563680:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832224.563729:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283537e49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0496d expref: 48 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.563748:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2c39194a00) 00010000:00010000:2.0:1788832224.563753:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832224.563814:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:352fff76-09db-42cd-818a-16e788a01abb+47:2395:x1875726202665856:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 150us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832224.563821:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:0.0:1788832224.571091:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832224.571183:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202665984 00000100:00100000:1.0:1788832224.571202:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202665984 00000100:00100000:1.0:1788832224.571261:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 70 00000100:00100000:1.0:1788832224.571276:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+8:2393:x1875726202665984:12345-192.168.203.26@tcp:1:lfs.0 00010000:00010000:1.0:1788832224.571320:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537e6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.571341:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283537e2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0495f expref: 8 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.571349:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832224.571353:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788832224.571357:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537e6c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.571392:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283537e2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0495f expref: 8 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.571418:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283537e2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0495f expref: 8 pid: 10097 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832224.571433:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8440:1875726218442112:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788832224.571524:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c1b3d5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788832224.575929:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832224.576006:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202666112 00000100:00100000:2.0:1788832224.576016:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202666112 00002000:00100000:2.0:1788832224.576071:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9d2b0857df80 x1875726202666112/t0(0) o4->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:165/0 lens 504/0 e 0 to 0 dl 1788832235 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788832224.576082:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2b0857df80 with x1875726202666112 ext(0->8) 00010000:00010000:2.0:1788832224.576091:0:8447:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283537e2d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0495f expref: 9 pid: 10097 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.576106:0:8447:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283537e2d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0495f expref: 9 pid: 10097 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788832224.576114:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d2b0857df80 00000100:00100000:2.0:1788832224.576147:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:2.0:1788832224.576157:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:352fff76-09db-42cd-818a-16e788a01abb+9:2394:x1875726202666112:12345-192.168.203.26@tcp:4:lfs.0 00000100:00100000:0.0:1788832224.576839:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8440:1875726218442112:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788832224.576863:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537e6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832224.577909:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:352fff76-09db-42cd-818a-16e788a01abb+11:2394:x1875726202666112:12345-192.168.203.26@tcp:4:lfs.0 Request processed in 1746us (1984us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788832224.577922:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 3 00002000:00100000:2.0:1788832224.577934:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9d2b0857df80 x1875726202666112/t4294967309(0) o4->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:165/0 lens 504/448 e 0 to 0 dl 1788832235 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788832224.577955:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2b0857df80 with x1875726202666112 ext(0->8) 00010000:00010000:2.0:1788832224.577965:0:8447:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283537e2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0495f expref: 11 pid: 10097 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.577981:0:8447:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283537e2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0495f expref: 11 pid: 10097 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788832224.577989:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d2b0857df80 00000001:00080000:0.0:1788832224.580421:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1788832224.580438:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:3.0:1788832224.582404:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832224.582604:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202666240 00000100:00100000:2.0:1788832224.582614:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202666240 00010000:00010000:2.0:1788832224.582689:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283537e2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0495f expref: 7 pid: 10097 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832224.582735:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 95 00000100:00100000:2.0:1788832224.582745:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+7:2393:x1875726202666240:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832224.582760:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788832224.582779:0:10344:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788832224.582782:0:10344:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788832224 00002000:00010000:2.0:1788832224.582784:0:10344:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788832225 00002000:00010000:2.0:1788832224.582787:0:10344:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788832224 00002000:00010000:2.0:1788832224.582789:0:10344:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788832224.582795:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283537e2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0495f expref: 7 pid: 10097 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.582810:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283537e2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0495f expref: 7 pid: 10097 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.582864:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283537e2d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0495f expref: 7 pid: 10097 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.582884:0:10344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832224.582888:0:10344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832224.582894:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537e6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.582905:0:10344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537e6c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.582930:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832224.582990:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+6:2393:x1875726202666240:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 247us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832224.582998:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 95 00010000:00010000:0.0:1788832224.583398:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537e6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.583409:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537e6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.583430:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537e6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.583438:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537e6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.583447:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537e6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.583463:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfee00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:0.0:1788832224.583468:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537e6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.583477:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537e6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.583496:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537e6c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.583504:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9d990f5/0x998c12b283537e6c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832224.583570:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2393:x1875726202665984:12345-192.168.203.26@tcp:1:lfs.0 Request processed in 12299us (12488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832224.583579:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 70 00000100:00100000:0.0:1788832224.589778:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832224.589862:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202666496 00000100:00100000:3.0:1788832224.589873:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202666496 00000100:00100000:3.0:1788832224.589920:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:3.0:1788832224.589930:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18f28050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+47:12452:x1875726202666496:12345-192.168.203.26@tcp:35:lfs.0 00000004:00010000:3.0:1788832224.590018:0:6529:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537e5e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04974 expref: 47 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788832224.590373:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788832224.590407:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1788832224.591238:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:3.0:1788832224.591288:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537e73 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832224.591306:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537e18 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04951 expref: 51 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832224.591315:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537e73 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.593304:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537e18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04951 expref: 51 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.593328:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537e18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04951 expref: 51 pid: 6527 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832224.593345:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6529:1875726218442240:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788832224.593566:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788832224.600256:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832224.601245:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202666624 00000100:00100000:3.0:1788832224.601258:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202666624 00010000:00010000:3.0:1788832224.601309:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537e18 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04951 expref: 52 pid: 6527 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832224.601360:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 96 00000100:00100000:3.0:1788832224.601371:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+52:2393:x1875726202666624:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832224.601384:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832224.601392:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537e18 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04951 expref: 52 pid: 6527 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832224.601405:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537e18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04951 expref: 52 pid: 6527 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832224.601428:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2c39194a00) 00010000:00010000:3.0:1788832224.601433:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537e73 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832224.601442:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537e73 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832224.601450:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537e73 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832224.601469:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832224.601531:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+52:2393:x1875726202666624:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 162us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832224.601539:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 96 00010000:00010000:2.0:1788832224.601838:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d800/0x998c12b283537e18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04951 expref: 51 pid: 6527 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832224.601869:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6529:1875726218442240:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832224.601891:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537e73 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.601900:0:6529:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537e73 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.601922:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537e73 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788832224.602057:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:2.0:1788832224.602177:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1788832224.602269:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1875726218442368:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788832224.602320:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832224.602354:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c21b376c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832224.604840:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218442368 00000100:00100000:3.0:1788832224.604855:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218442368 00000100:00100000:3.0:1788832224.604988:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788832224.605008:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6529:x1875726218442368:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788832224.605157:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6529:x1875726218442368:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 151us (2836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832224.605165:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788832224.606455:0:6529:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:2.0:1788832224.606466:0:6529:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:2.0:1788832224.606485:0:6529:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d2b07ddfb80, transno 4294967308 00000100:00100000:2.0:1788832224.606501:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1875726218442368:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788832224.606686:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:2.0:1788832224.606761:0:6529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1875726218442496:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788832224.606818:0:6529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832224.606845:0:6529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c05580780 going to sleep for 11 seconds 00000100:00100000:0.0:1788832224.608487:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218442496 00000100:00100000:0.0:1788832224.608500:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218442496 00000100:00100000:0.0:1788832224.608578:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788832224.608599:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6529:x1875726218442496:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788832224.608903:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6529:x1875726218442496:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 315us (2083us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788832224.608911:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788832224.609782:0:6529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6529:1875726218442496:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788832224.609857:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1788832224.609900:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537e73 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.609918:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537e73 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.609925:0:6529:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537e73 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.609931:0:6529:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832224.609935:0:6529:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537e73 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.609942:0:6529:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537e73 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.609960:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2c39194a00) 00010000:00010000:2.0:1788832224.609963:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788832224.609968:0:6529:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537e73 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.609974:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2200/0x998c12b283537e73 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788832224.610117:0:6529:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788832224.610173:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1788832224.610184:0:6529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 364650562900ns, next at 365650560512ns, rc = 0 00000001:00080000:2.0:1788832224.610190:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:2.0:1788832224.610212:0:6529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2c39194a00) 00010000:00010000:2.0:1788832224.610215:0:6529:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788832224.610222:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537e5e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04974 expref: 55 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832224.610347:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18f28050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+54:12452:x1875726202666496:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 20417us (20578us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788832224.610356:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 56 00000020:00080000:2.0:1788832224.610360:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:1.0:1788832224.613235:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788832224.613724:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832224.613951:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202666752 00000100:00100000:1.0:1788832224.613961:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202666752 00000100:00100000:1.0:1788832224.614176:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 219 00000100:00100000:1.0:1788832224.614187:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+54:12452:x1875726202666752:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788832224.614279:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832224.614305:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b283537e7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0497b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.614359:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b283537e7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0497b expref: 55 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.614374:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b283537e7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0497b expref: 55 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.614392:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:1.0:1788832224.614395:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788832224.614397:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe800, rc 0) 00000100:00100000:1.0:1788832224.614509:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+55:12452:x1875726202666752:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 323us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832224.614516:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 219 00000100:00100000:3.0:1788832224.622914:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832224.625381:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202667008 00000100:00100000:1.0:1788832224.625398:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202667008 00000100:00100000:1.0:1788832224.625473:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:1.0:1788832224.625483:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+55:12452:x1875726202667008:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1788832224.625776:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+56:12452:x1875726202667008:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 292us (2872us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788832224.625784:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 57 00010000:00010000:1.0:1788832224.726853:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832224.757325:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832224.759660:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202667136 00000100:00100000:0.0:1788832224.759675:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202667136 00000100:00100000:0.0:1788832224.759761:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 220 00000100:00100000:0.0:1788832224.759773:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+56:12462:x1875726202667136:12345-192.168.203.26@tcp:34:lfs.0 00010000:00010000:0.0:1788832224.759849:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537e81 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.759866:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537e81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.759876:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537e81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.759887:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537e88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.759901:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537e88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.759907:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537e88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.759977:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c200/0x998c12b283537e8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760002:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c200/0x998c12b283537e8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760010:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c200/0x998c12b283537e8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788832224.760064:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c200/0x998c12b283537e8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760090:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537e81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760096:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537e81 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760103:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537e81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760108:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0d200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832224.760112:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537e81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760120:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537e81 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760131:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:0.0:1788832224.760134:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832224.760139:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537e81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760144:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283537e81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760366:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537e88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760373:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537e88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760378:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537e88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760389:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832224.760392:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537e88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760399:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537e88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760408:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2b073ad400) 00010000:00010000:0.0:1788832224.760410:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832224.760413:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537e88 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760419:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537e88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760427:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c200/0x998c12b283537e8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760432:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c200/0x998c12b283537e8f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760437:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c200/0x998c12b283537e8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760442:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832224.760444:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c200/0x998c12b283537e8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760449:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c200/0x998c12b283537e8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760464:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:0.0:1788832224.760466:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832224.760469:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c200/0x998c12b283537e8f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.760474:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c200/0x998c12b283537e8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832224.760561:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+56:12462:x1875726202667136:12345-192.168.203.26@tcp:34:lfs.0 Request processed in 787us (3244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832224.760570:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 220 00000100:00100000:0.0:1788832224.840773:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832224.840879:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202667392 00000100:00100000:2.0:1788832224.840890:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202667392 00000100:00100000:2.0:1788832224.840953:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 221 00000100:00100000:2.0:1788832224.840963:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+56:12465:x1875726202667392:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788832224.840982:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832224.841004:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537e96 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04982 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841092:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537e9d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841108:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537e9d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841119:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537e9d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841129:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537ea4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841136:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841141:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841269:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537eab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841277:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537eab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841284:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537eab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832224.841293:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788832224.841365:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537e9d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841372:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537e9d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841379:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537e9d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841385:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030c00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832224.841389:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537e9d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841396:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537e9d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841407:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:2.0:1788832224.841411:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832224.841415:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537e9d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841430:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537e9d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841446:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841452:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537ea4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841458:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841463:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031e00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832224.841466:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841471:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537ea4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841479:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2b073ad400) 00010000:00010000:2.0:1788832224.841482:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832224.841485:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537ea4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841491:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537ea4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841526:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b283537e96 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04982 expref: 59 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841705:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537eab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04982 expref: 58 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.841715:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:2.0:1788832224.841717:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832224.841720:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031600, rc 0) 00000100:00100000:2.0:1788832224.843471:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+58:12465:x1875726202667392:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 2499us (2697us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1788832224.843484:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 221 00000100:00100000:3.0:1788832224.851409:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832224.852958:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202667520 00000100:00100000:1.0:1788832224.852972:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202667520 00000100:00100000:1.0:1788832224.853047:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 222 00000100:00100000:1.0:1788832224.853058:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+58:12465:x1875726202667520:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:1.0:1788832224.853137:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537eb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.853155:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.853167:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.853206:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.853213:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537eb9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.853242:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.853247:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfee00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832224.853251:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.853259:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537eb9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.853270:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:1.0:1788832224.853273:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788832224.853277:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537eb9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.853284:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfee00/0x998c12b283537eb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832224.853358:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+58:12465:x1875726202667520:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 302us (1958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832224.853365:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 222 00000100:00100000:1.0:1788832224.858136:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832224.858281:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202667776 00000100:00100000:3.0:1788832224.858291:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202667776 00000100:00100000:3.0:1788832224.858352:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:3.0:1788832224.858362:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+58:12465:x1875726202667776:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:3.0:1788832224.858854:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+59:12465:x1875726202667776:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 491us (723us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788832224.858863:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:0.0:1788832224.955318:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832224.955474:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202668032 00000100:00100000:1.0:1788832224.955484:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202668032 00000100:00100000:1.0:1788832224.955544:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 223 00000100:00100000:1.0:1788832224.955555:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+59:12475:x1875726202668032:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1788832224.955579:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832224.955583:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788832224.955661:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe600/0x998c12b283537e3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04966 expref: 59 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.955695:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:1.0:1788832224.955700:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788832224.955712:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537ec0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04989 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.955811:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537ec7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.955825:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537eab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04982 expref: 59 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.955833:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537ec7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.955865:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537eab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04982 expref: 59 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832224.955879:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537eab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04982 expref: 59 pid: 13811 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832224.955892:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1875726218442624:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788832224.955987:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c1b3d5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832224.958356:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1875726218442624:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832224.958385:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537ec7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832224.961605:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832224.961715:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202668160 00000100:00100000:2.0:1788832224.961725:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202668160 00010000:00010000:2.0:1788832224.961764:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537eab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04982 expref: 60 pid: 13811 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832224.961800:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 97 00000100:00100000:2.0:1788832224.961809:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+60:2393:x1875726202668160:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832224.961822:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832224.961828:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537eab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04982 expref: 60 pid: 13811 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.961843:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537eab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04982 expref: 60 pid: 13811 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.961884:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031600/0x998c12b283537eab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04982 expref: 60 pid: 13811 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.961918:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:2.0:1788832224.961924:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537ec7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.961935:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537ec7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.961943:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537ec7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.961972:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832224.962018:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+59:2393:x1875726202668160:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 210us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832224.962026:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 97 00010000:00010000:0.0:1788832224.963063:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537ec7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.963076:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537ec7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832224.963096:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788832224.963228:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283537ec0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04989 expref: 60 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.963247:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537ec7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04989 expref: 59 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.963255:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:0.0:1788832224.963270:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788832224.963273:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cff400, rc 0) 00000100:00100000:0.0:1788832224.964072:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+59:12475:x1875726202668032:12345-192.168.203.26@tcp:101:bash.0 Request processed in 8512us (8770us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788832224.964082:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 223 00000100:00100000:0.0:1788832224.967056:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832224.971428:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202668288 00000100:00100000:2.0:1788832224.971443:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202668288 00000100:00100000:2.0:1788832224.972333:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 224 00000100:00100000:2.0:1788832224.972351:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+59:12475:x1875726202668288:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:2.0:1788832224.972377:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832224.972400:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537ed5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04990 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.972440:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537edc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.972472:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537edc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.972485:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537edc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.972608:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283537ed5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04990 expref: 61 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.972647:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537edc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04990 expref: 60 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832224.972656:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:2.0:1788832224.972659:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788832224.972664:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031e00, rc 0) 00000100:00100000:2.0:1788832224.972727:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+60:12475:x1875726202668288:12345-192.168.203.26@tcp:101:bash.0 Request processed in 382us (5680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832224.972736:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 224 00000100:00100000:1.0:1788832224.976380:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832224.987097:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832224.990569:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202668544 00000100:00100000:0.0:1788832224.990671:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202668544 00000100:00100000:0.0:1788832224.990755:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 225 00000100:00100000:0.0:1788832224.990766:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+60:12475:x1875726202668544:12345-192.168.203.26@tcp:36:bash.0 00010000:00010000:0.0:1788832224.991012:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537ee3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.991030:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.991041:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788832224.991086:0:6527:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:0.0:1788832224.991108:0:6527:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1ee2f9e reply state 000000001e83b584 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.991121:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537ee3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832224.991129:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:0.0:1788832224.991131:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788832224.991135:0:6527:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788832224.991228:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+63:12475:x1875726202668544:12345-192.168.203.26@tcp:36:bash.0 Request processed in 462us (14856us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1788832224.991253:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 225 00000020:00080000:0.0:1788832224.991259:0:6527:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788832224.992833:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832224.992879:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832224.992903:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832224.992936:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202668672 00000100:00100000:1.0:1788832224.992943:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202668672 00000100:00100000:1.0:1788832224.992990:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 387 00000100:00100000:1.0:1788832224.993000:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2395:x1875726202668672:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832224.993059:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2395:x1875726202668672:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 61us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832224.993066:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 387 00000100:00100000:1.0:1788832224.993113:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832224.993215:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832224.993216:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202669056 00000100:00100000:2.0:1788832224.993221:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202669056 00000100:00100000:1.0:1788832224.993233:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202668928 00000100:00100000:1.0:1788832224.993236:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202668928 00000100:00100000:2.0:1788832224.993251:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 131 00000100:00100000:1.0:1788832224.993256:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 132 00000100:00100000:2.0:1788832224.993258:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202669056:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832224.993261:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:352fff76-09db-42cd-818a-16e788a01abb+9:2395:x1875726202668928:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832224.993289:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:352fff76-09db-42cd-818a-16e788a01abb+9:2395:x1875726202668928:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832224.993318:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202668800 00000100:00100000:0.0:1788832224.993322:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202668800 00000100:00100000:0.0:1788832224.993369:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202669312 00000100:00100000:0.0:1788832224.993372:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202669312 00000100:00100000:0.0:1788832224.993387:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202669184 00000100:00100000:0.0:1788832224.993389:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202669184 00000100:00100000:0.0:1788832224.993405:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 318 00000100:00100000:0.0:1788832224.993412:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202668800:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832224.993580:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 132 00000100:00100000:3.0:1788832224.995676:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 319 00000100:00100000:3.0:1788832224.995698:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2395:x1875726202669312:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832224.997686:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202669056:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 4415us (4848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832224.997700:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 131 00000100:00100000:2.0:1788832224.997777:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 320 00000100:00100000:2.0:1788832224.997790:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2395:x1875726202669184:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832224.997872:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2395:x1875726202669184:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 85us (4655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832224.997879:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 320 00000100:00080000:2.0:1788832224.998424:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788832224.998431:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788832224.999505:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+5:2395:x1875726202668800:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 6085us (12410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832224.999517:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 318 00000100:00100000:3.0:1788832225.001550:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2395:x1875726202669312:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 5607us (8415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832225.001566:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 319 00000100:00100000:2.0:1788832225.001598:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832225.001693:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202669440 00000100:00100000:3.0:1788832225.001703:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202669440 00000100:00080000:2.0:1788832225.001754:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832225.001767:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 226 00000100:00100000:3.0:1788832225.001776:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+63:12475:x1875726202669440:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788832225.001798:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832225.001835:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537eea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04997 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832225.001933:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537ef1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832225.001948:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537ec7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04989 expref: 64 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832225.001956:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537ef1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832225.001991:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537ec7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04989 expref: 64 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832225.002004:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537ec7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04989 expref: 64 pid: 6526 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832225.002017:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1875726218442752:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788832225.002138:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7180 going to sleep for 11 seconds 00000100:00100000:3.0:1788832225.003974:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1875726218442752:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788832225.003999:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537ef1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832225.004578:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832225.004874:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202669568 00000100:00100000:3.0:1788832225.004892:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202669568 00010000:00010000:3.0:1788832225.004927:0:7466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537ec7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04989 expref: 65 pid: 6526 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832225.004977:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 98 00000100:00100000:3.0:1788832225.004987:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+65:2393:x1875726202669568:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832225.005001:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832225.005009:0:7466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537ec7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04989 expref: 65 pid: 6526 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832225.005020:0:7466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537ec7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04989 expref: 65 pid: 6526 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832225.005042:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537ec7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04989 expref: 65 pid: 6526 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832225.005056:0:7466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:3.0:1788832225.005061:0:7466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537ef1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832225.005070:0:7466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832225.005076:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537ef1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832225.005106:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832225.005165:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+64:2393:x1875726202669568:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 178us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832225.005172:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 98 00010000:00010000:1.0:1788832225.005301:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832225.005309:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832225.005360:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788832225.005365:0:6525:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788832225.005386:0:6525:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832225.005419:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2a00/0x998c12b283537eea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04997 expref: 65 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832225.005442:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04997 expref: 64 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832225.005450:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:1.0:1788832225.005453:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788832225.005455:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2800, rc 0) 00000100:00100000:1.0:1788832225.005783:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+63:12475:x1875726202669440:12345-192.168.203.26@tcp:101:bash.0 Request processed in 4006us (4195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832225.005790:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 226 00000100:00100000:2.0:1788832225.010331:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832225.010442:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202669824 00000100:00100000:0.0:1788832225.010453:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202669824 00000100:00100000:0.0:1788832225.010511:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:0.0:1788832225.010522:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+63:12475:x1875726202669824:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:0.0:1788832225.010779:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+64:12475:x1875726202669824:12345-192.168.203.26@tcp:35:bash.0 Request processed in 258us (456us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788832225.010786:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:0.0:1788832225.134836:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832225.135006:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202669952 00000100:00100000:2.0:1788832225.135016:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202669952 00000100:00100000:2.0:1788832225.135076:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 227 00000100:00100000:2.0:1788832225.135085:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+64:12481:x1875726202669952:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788832225.135109:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832225.135130:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2800/0x998c12b283537ef8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc0499e expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832225.135219:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2600/0x998c12b283537eff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832225.135234:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2600/0x998c12b283537eff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832225.135246:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2600/0x998c12b283537eff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832225.135291:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788832225.135295:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788832225.135325:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2600/0x998c12b283537eff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832225.135359:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2800/0x998c12b283537ef8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0499e expref: 66 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832225.135380:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2600/0x998c12b283537eff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0499e expref: 65 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832225.135389:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:2.0:1788832225.135391:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788832225.135395:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c390f2600, rc 0) 00000100:00100000:2.0:1788832225.135463:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+65:12481:x1875726202669952:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 379us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832225.135470:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 227 00000100:00100000:2.0:1788832225.138911:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832225.139194:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202670080 00000100:00100000:0.0:1788832225.139207:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202670080 00000100:00100000:0.0:1788832225.139271:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 228 00000100:00100000:0.0:1788832225.139281:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+65:12481:x1875726202670080:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788832225.139313:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832225.139351:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b283537f06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc049a5 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.139414:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537f0d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.139428:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537f0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.139439:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537f0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.139451:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b283537f14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.139458:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b283537f14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.139464:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b283537f14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.139798:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537f1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.139809:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537f1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.139816:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537f1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832225.139860:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788832225.139864:0:13811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788832225.139886:0:13811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537f1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.139906:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537f1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.139914:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537f0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.139919:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537f0d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.139925:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537f0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.139931:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0d600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832225.139934:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537f0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.139941:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537f0d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.139952:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:0.0:1788832225.139955:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832225.139960:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537f0d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.139966:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d600/0x998c12b283537f0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.139978:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b283537f14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.139983:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b283537f14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.139995:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b283537f14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.140001:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832225.140003:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b283537f14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.140009:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b283537f14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.140018:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2b073ad400) 00010000:00010000:0.0:1788832225.140020:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832225.140023:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b283537f14 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.140029:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c600/0x998c12b283537f14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.140057:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ce00/0x998c12b283537f06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049a5 expref: 67 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.140070:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537f1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049a5 expref: 66 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832225.140077:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:0.0:1788832225.140079:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788832225.140081:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0c400, rc 0) 00000100:00100000:0.0:1788832225.140137:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+66:12481:x1875726202670080:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 857us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832225.140154:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 228 00000100:00100000:3.0:1788832225.145482:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832225.145866:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202670208 00000100:00100000:1.0:1788832225.145877:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202670208 00000100:00100000:1.0:1788832225.145959:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:1.0:1788832225.145971:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+66:2393:x1875726202670208:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832225.145987:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832225.146017:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c400/0x998c12b283537f1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049a5 expref: 66 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832225.146036:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:1.0:1788832225.146041:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832225.146231:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+65:2393:x1875726202670208:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 260us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832225.146238:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:2.0:1788832225.149195:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832225.149350:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202670464 00000100:00100000:3.0:1788832225.149362:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202670464 00000100:00100000:3.0:1788832225.149421:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 229 00000100:00100000:3.0:1788832225.149431:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+65:12481:x1875726202670464:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788832225.149452:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832225.149473:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537f22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc049ac expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832225.149606:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537f29 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832225.149652:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537ef1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04997 expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832225.149663:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537f29 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832225.149700:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04997 expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832225.149714:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537ef1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04997 expref: 66 pid: 6525 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832225.149727:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1875726218442880:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788832225.149828:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7180 going to sleep for 11 seconds 00000100:00100000:3.0:1788832225.152991:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6525:1875726218442880:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788832225.152994:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00010000:00010000:3.0:1788832225.153017:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537f29 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832225.153116:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202670592 00000100:00100000:2.0:1788832225.153124:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202670592 00010000:00010000:2.0:1788832225.153168:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537ef1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04997 expref: 67 pid: 6525 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832225.153207:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 99 00000100:00100000:2.0:1788832225.153216:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c0947a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+67:2393:x1875726202670592:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832225.153230:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832225.153236:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537ef1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04997 expref: 67 pid: 6525 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832225.153248:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04997 expref: 67 pid: 6525 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832225.153279:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2800/0x998c12b283537ef1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04997 expref: 67 pid: 6525 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832225.153295:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:2.0:1788832225.153300:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537f29 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832225.153309:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537f29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832225.153316:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537f29 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832225.153347:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832225.153409:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c0947a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+66:2393:x1875726202670592:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 194us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832225.153417:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 99 00010000:00010000:1.0:1788832225.154051:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537f29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832225.154073:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537f29 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832225.154091:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788832225.154243:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537f22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049ac expref: 67 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832225.154264:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537f29 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049ac expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832225.154272:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:1.0:1788832225.154275:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788832225.154277:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d3400, rc 0) 00000100:00100000:1.0:1788832225.154471:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+66:12481:x1875726202670464:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 5040us (5289us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788832225.154484:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 229 00000100:00100000:1.0:1788832225.156922:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832225.156975:0:7466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202670848 00000100:00100000:3.0:1788832225.156984:0:7466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202670848 00000100:00100000:3.0:1788832225.157075:0:7466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:3.0:1788832225.157086:0:7466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+66:12481:x1875726202670848:12345-192.168.203.26@tcp:103:lfs.0 00010000:00010000:3.0:1788832225.157100:0:7466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832225.157125:0:7466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b283537e7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0497b expref: 66 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832225.157142:0:7466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:3.0:1788832225.157147:0:7466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832225.157478:0:7466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:352fff76-09db-42cd-818a-16e788a01abb+65:12481:x1875726202670848:12345-192.168.203.26@tcp:103:lfs.0 Request processed in 393us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832225.157486:0:7466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:0.0:1788832225.159293:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832225.159495:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202670976 00000100:00100000:2.0:1788832225.159503:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202670976 00000100:00100000:2.0:1788832225.159818:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 230 00000100:00100000:2.0:1788832225.159829:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+65:12481:x1875726202670976:12345-192.168.203.26@tcp:58:lfs.0 00010000:00010000:2.0:1788832225.159943:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2800/0x998c12b283537f37 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832225.159960:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2800/0x998c12b283537f37 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832225.159972:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2800/0x998c12b283537f37 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788832225.160081:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788832225.160211:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+65:12481:x1875726202670976:12345-192.168.203.26@tcp:58:lfs.0 Request processed in 384us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832225.160218:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 230 00000100:00100000:0.0:1788832225.162433:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832225.162509:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202671104 00000100:00100000:2.0:1788832225.162518:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202671104 00000100:00100000:2.0:1788832225.162580:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 231 00000100:00100000:2.0:1788832225.162601:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+65:12481:x1875726202671104:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788832225.162651:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832225.162672:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2400/0x998c12b283537f3e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc049b3 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832225.162725:0:13811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2800/0x998c12b283537f37 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832225.162735:0:13811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2400/0x998c12b283537f3e lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049b3 expref: 66 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832225.162755:0:13811:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2800/0x998c12b283537f37 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832225.162768:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2400/0x998c12b283537f3e lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049b3 expref: 66 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832225.162781:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:2.0:1788832225.162784:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788832225.162788:0:13811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2400/0x998c12b283537f3e lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049b3 expref: 66 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832225.162811:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c390f2400, rc 0) 00000100:00100000:2.0:1788832225.162876:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+66:12481:x1875726202671104:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 277us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832225.162882:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 231 00010000:00010000:0.0:1788832225.751150:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788832226.070938:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832226.070947:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832226.070971:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788832226.070979:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788832226.071108:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875726218443008:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788832226.071240:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b0720da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788832226.075424:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875726218443008:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788832226.079820:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832226.079931:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202671232 00000100:00100000:1.0:1788832226.079941:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202671232 00000100:00100000:1.0:1788832226.080002:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 232 00000100:00100000:1.0:1788832226.080013:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c09268850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+66:12482:x1875726202671232:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788832226.080045:0:6525:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788832226.080168:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c09268850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+66:12482:x1875726202671232:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 156us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832226.080176:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 232 00000100:00100000:0.0:1788832226.087796:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832226.087970:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202671360 00000100:00100000:2.0:1788832226.087983:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202671360 00000100:00100000:2.0:1788832226.088044:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 233 00000100:00100000:2.0:1788832226.088056:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+66:12482:x1875726202671360:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788832226.088156:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2e00/0x998c12b283537f45 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088186:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2e00/0x998c12b283537f45 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088200:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2e00/0x998c12b283537f45 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088246:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283537f4c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088255:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283537f4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088262:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283537f4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088287:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228000/0x998c12b283537f53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088318:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228000/0x998c12b283537f53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088327:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228000/0x998c12b283537f53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832226.088387:0:6526:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788832226.088392:0:6526:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788832226.088408:0:6526:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228000/0x998c12b283537f53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088422:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2e00/0x998c12b283537f45 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088429:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2e00/0x998c12b283537f45 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088437:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2e00/0x998c12b283537f45 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088443:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c390f2e00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832226.088447:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2e00/0x998c12b283537f45 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088454:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2e00/0x998c12b283537f45 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088465:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d2b073ae800) 00010000:00010000:2.0:1788832226.088468:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832226.088473:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2e00/0x998c12b283537f45 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088488:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2e00/0x998c12b283537f45 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088506:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283537f4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088512:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283537f4c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088518:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283537f4c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088522:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01228800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832226.088525:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283537f4c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088531:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283537f4c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088538:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9d2c36bdbd00) 00010000:00010000:2.0:1788832226.088541:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832226.088543:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283537f4c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088548:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283537f4c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088563:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228000/0x998c12b283537f53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088569:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228000/0x998c12b283537f53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088592:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228000/0x998c12b283537f53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088597:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01228000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832226.088600:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228000/0x998c12b283537f53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088606:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228000/0x998c12b283537f53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088614:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:2.0:1788832226.088616:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832226.088684:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228000/0x998c12b283537f53 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.088692:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228000/0x998c12b283537f53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832226.091616:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+66:12482:x1875726202671360:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 Request processed in 3549us (3819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832226.091663:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 233 00000100:00100000:2.0:1788832226.101855:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832226.106242:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202671616 00000100:00100000:0.0:1788832226.106257:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202671616 00000100:00100000:1.0:1788832226.107496:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 234 00000100:00100000:1.0:1788832226.107511:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+66:12482:x1875726202671616:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788832226.107538:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832226.107564:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537f5a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc049ba expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.107765:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537f61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.107782:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537f61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.107796:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537f61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832226.107809:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788832226.107907:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537f61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.107914:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537f61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.107920:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537f61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.107926:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832226.107931:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537f61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.107938:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537f61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.107971:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:1.0:1788832226.107973:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788832226.107978:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537f61 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.107983:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b283537f61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.108025:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537f5a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049ba expref: 68 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.108036:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d2b073ae800) 00010000:00010000:1.0:1788832226.108039:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788832226.108043:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b283537f5a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049ba expref: 68 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.108053:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cff600, rc 0) 00000100:00100000:1.0:1788832226.108116:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+67:12482:x1875726202671616:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 608us (6269us total) trans 4294967506 rc 301/301 00000100:00100000:1.0:1788832226.108123:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 234 00000100:00100000:0.0:1788832226.116867:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832226.117194:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202671744 00000100:00100000:2.0:1788832226.117204:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202671744 00000100:00100000:2.0:1788832226.117271:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 235 00000100:00100000:2.0:1788832226.117282:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+67:12482:x1875726202671744:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788832226.117328:0:8742:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788832226.117447:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+67:12482:x1875726202671744:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 167us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832226.117476:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 235 00000100:00100000:0.0:1788832226.132867:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832226.133074:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202672000 00000100:00100000:2.0:1788832226.133084:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202672000 00000100:00100000:2.0:1788832226.133145:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 236 00000100:00100000:2.0:1788832226.133155:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+67:12482:x1875726202672000:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788832226.133176:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832226.133191:0:6526:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788832226.133220:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2600/0x998c12b283537eff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0499e expref: 67 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.133240:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:2.0:1788832226.133244:0:6526:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788832226.133257:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228000/0x998c12b283537f6f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc049c1 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788832226.133893:0:6526:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788832226.134044:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283537f76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.134059:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283537f76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.134069:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283537f76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.134122:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228000/0x998c12b283537f6f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049c1 expref: 69 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.134159:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283537f76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049c1 expref: 68 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.134169:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d2c36bdbd00) 00010000:00010000:2.0:1788832226.134173:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832226.134943:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c01228800, rc 0) 00000100:00100000:2.0:1788832226.135022:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+68:12482:x1875726202672000:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 1866us (2164us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788832226.135032:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 236 00000100:00100000:1.0:1788832226.150347:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832226.150459:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202672256 00000100:00100000:3.0:1788832226.150469:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202672256 00000100:00100000:3.0:1788832226.150692:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 237 00000100:00100000:3.0:1788832226.150705:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+68:12482:x1875726202672256:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788832226.150765:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832226.150792:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283537f76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049c1 expref: 68 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.150812:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d2c36bdbd00) 00010000:00010000:3.0:1788832226.150822:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788832226.150846:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537f84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.150875:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537f84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.150885:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537f84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.152290:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537f8b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x20db4751 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.152308:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537f8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x20db4751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.152318:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537f8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x20db4751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.152375:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537f84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.152382:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537f84 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.152388:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537f84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.152394:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d3000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832226.152399:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537f84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.152407:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537f84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.152419:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:3.0:1788832226.152434:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832226.152440:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537f84 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.152446:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283537f84 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.152462:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537f8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x20db4751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.152467:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537f8b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x20db4751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.152473:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537f8b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x20db4751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.152478:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832226.152481:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537f8b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x20db4751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.152487:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537f8b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x20db4751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.152494:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x20db4751 (ffff9d2c0ad05800) 00010000:00010000:3.0:1788832226.152496:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832226.152498:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537f8b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x20db4751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.152504:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537f8b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x20db4751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832226.152635:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+67:12482:x1875726202672256:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 1915us (2278us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788832226.152651:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 237 00000100:00100000:0.0:1788832226.156726:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832226.156837:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202672384 00000100:00100000:2.0:1788832226.156847:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202672384 00000100:00100000:2.0:1788832226.157024:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 238 00000100:00100000:2.0:1788832226.157035:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+67:12482:x1875726202672384:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788832226.157055:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832226.157077:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228000/0x998c12b283537f92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc049c8 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.157111:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b283537f99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.157123:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b283537f99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.157134:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b283537f99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.157254:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228000/0x998c12b283537f92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049c8 expref: 69 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.157282:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b283537f99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049c8 expref: 68 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.157290:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:2.0:1788832226.157293:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788832226.157297:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c01229a00, rc 0) 00000100:00100000:2.0:1788832226.157362:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+68:12482:x1875726202672384:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 329us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832226.157369:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 238 00000100:00100000:1.0:1788832226.162275:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832226.162353:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202672640 00000100:00100000:2.0:1788832226.162364:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202672640 00000100:00100000:2.0:1788832226.162436:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 239 00000100:00100000:2.0:1788832226.162446:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+68:12482:x1875726202672640:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788832226.162535:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229e00/0x998c12b283537fa0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.162552:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229e00/0x998c12b283537fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.162565:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229e00/0x998c12b283537fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788832226.162770:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1788832226.162781:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366203159487ns, next at 367203156539ns, rc = 0 00000004:00010000:2.0:1788832226.162834:0:6526:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fe19d49 reply state 0000000024a518f6 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229e00/0x998c12b283537fa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.162868:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229e00/0x998c12b283537fa0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.162875:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:2.0:1788832226.162878:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788832226.162882:0:6526:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788832226.163006:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+70:12482:x1875726202672640:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 560us (739us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788832226.163014:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 239 00000100:00100000:3.0:1788832226.168556:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832226.168695:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202672768 00000100:00100000:1.0:1788832226.168705:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202672768 00000100:00100000:1.0:1788832226.168767:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 240 00000100:00100000:1.0:1788832226.168779:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+70:12482:x1875726202672768:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788832226.168803:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832226.168836:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537fa7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc049cf expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.168902:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537fa7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049cf expref: 71 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.168920:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537fa7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049cf expref: 71 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.168937:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:1.0:1788832226.168941:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788832226.168946:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cff400, rc 0) 00000100:00100000:1.0:1788832226.169010:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+71:12482:x1875726202672768:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 233us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832226.169017:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 240 00000100:00100000:3.0:1788832226.172661:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832226.172751:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202672896 00000100:00100000:0.0:1788832226.172761:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202672896 00000100:00100000:0.0:1788832226.172841:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00100000:0.0:1788832226.172852:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+9:2393:x1875726202672896:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788832226.173073:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+10:2393:x1875726202672896:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 205us (560us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788832226.173080:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 71 00000100:00080000:2.0:1788832226.173399:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788832226.182423:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832226.182543:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202673152 00000100:00100000:2.0:1788832226.182553:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202673152 00000100:00100000:2.0:1788832226.182651:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:2.0:1788832226.182663:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+71:12482:x1875726202673152:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788832226.182887:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+72:12482:x1875726202673152:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 225us (473us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788832226.182895:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:3.0:1788832226.186557:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832226.187256:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202673408 00000100:00100000:2.0:1788832226.187267:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202673408 00000100:00100000:2.0:1788832226.187347:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 241 00000100:00100000:2.0:1788832226.187358:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+72:12482:x1875726202673408:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788832226.187475:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+72:12482:x1875726202673408:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 118us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832226.187483:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 241 00000100:00100000:0.0:1788832226.192721:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832226.192929:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202673536 00000100:00100000:2.0:1788832226.192945:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202673536 00000100:00100000:2.0:1788832226.193014:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 242 00000100:00100000:2.0:1788832226.193024:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+72:12482:x1875726202673536:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788832226.193046:0:8742:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832226.193065:0:8742:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228000/0x998c12b283537fae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc049d6 expref: -99 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.193134:0:8742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229600/0x998c12b283537fb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.193147:0:8742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229600/0x998c12b283537fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.193158:0:8742:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229600/0x998c12b283537fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832226.193200:0:8742:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788832226.193219:0:8742:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229600/0x998c12b283537fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.193245:0:8742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228000/0x998c12b283537fae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049d6 expref: 74 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.193264:0:8742:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229600/0x998c12b283537fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049d6 expref: 73 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.193272:0:8742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:2.0:1788832226.193275:0:8742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788832226.193279:0:8742:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c01229600, rc 0) 00000100:00100000:2.0:1788832226.193756:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+73:12482:x1875726202673536:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 731us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832226.193772:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 242 00000100:00100000:1.0:1788832226.197740:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832226.197863:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202673664 00000100:00100000:0.0:1788832226.197873:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202673664 00000100:00100000:0.0:1788832226.197925:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:0.0:1788832226.197935:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+10:2394:x1875726202673664:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788832226.197954:0:8441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832226.197974:0:8441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537fbc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc049dd expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788832226.197996:0:8441:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f69e2, blocks: 0x0 00010000:00010000:0.0:1788832226.198016:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1788832226.198020:0:8441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832226.198029:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537fbc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049dd expref: 11 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.198046:0:8441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537fbc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049dd expref: 11 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.198058:0:8441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0d600, rc 0) 00000100:00100000:0.0:1788832226.198115:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+11:2394:x1875726202673664:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 182us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832226.198124:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 72 00000100:00100000:3.0:1788832226.201922:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832226.205015:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202673920 00000100:00100000:2.0:1788832226.205032:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202673920 00000100:00100000:2.0:1788832226.205203:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 243 00000100:00100000:2.0:1788832226.205215:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+73:12482:x1875726202673920:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788832226.205355:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+73:12482:x1875726202673920:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 142us (3441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832226.205362:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 243 00000100:00100000:3.0:1788832226.209986:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832226.210063:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202674048 00000100:00100000:2.0:1788832226.210073:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202674048 00000100:00100000:2.0:1788832226.210132:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 73 00000100:00100000:2.0:1788832226.210143:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+11:12482:x1875726202674048:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788832226.210162:0:10097:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832226.210180:0:10097:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283537fc3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc049e4 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.210211:0:10097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537fbc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049dd expref: 12 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.210219:0:10097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832226.210223:0:10097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832226.210227:0:10097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283537fc3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049e4 expref: 12 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.210259:0:10097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537fbc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049dd expref: 12 pid: 8441 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.210442:0:10097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537fbc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049dd expref: 12 pid: 8441 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832226.210460:0:10097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10097:1875726218443136:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788832226.210804:0:10097:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376180 going to sleep for 11 seconds 00000100:00100000:3.0:1788832226.216254:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832226.216298:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202674176 00000100:00100000:3.0:1788832226.216307:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202674176 00010000:00010000:3.0:1788832226.216347:0:10343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537fbc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049dd expref: 13 pid: 8441 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832226.216384:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 100 00000100:00100000:3.0:1788832226.216393:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+13:2393:x1875726202674176:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832226.216410:0:10343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832226.216432:0:10343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537fbc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049dd expref: 13 pid: 8441 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.216447:0:10343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537fbc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049dd expref: 13 pid: 8441 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.216474:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832226.216479:0:10343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832226.216487:0:10343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283537fc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049e4 expref: 13 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.216527:0:10343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283537fc3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049e4 expref: 13 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.216562:0:10343:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283537fc3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049e4 expref: 13 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832226.216575:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10343:1875726218443264:192.168.203.26@tcp:105: 00010000:00010000:2.0:1788832226.216811:0:10097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073f93abe/0x998c12b283537fbc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049dd expref: 13 pid: 8441 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832226.216828:0:10097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10097:1875726218443136:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832226.216852:0:10097:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283537fc3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049e4 expref: 12 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.216861:0:10097:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c01228000, rc 0) 00000100:00100000:3.0:1788832226.218175:0:10343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7180 going to sleep for 11 seconds 00000100:00100000:2.0:1788832226.218457:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+12:12482:x1875726202674048:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 8311us (8474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832226.218466:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 73 00000100:00100000:2.0:1788832226.223972:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832226.224571:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202674304 00000100:00100000:3.0:1788832226.224589:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202674304 00002000:00100000:3.0:1788832226.224667:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9d2b084f6300 x1875726202674304/t0(0) o4->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:167/0 lens 504/0 e 0 to 0 dl 1788832237 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788832226.224679:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2b084f6300 with x1875726202674304 ext(0->12) 00002000:00010000:3.0:1788832226.224684:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d2b084f6300 00000100:00100000:3.0:1788832226.224719:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:3.0:1788832226.224729:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:352fff76-09db-42cd-818a-16e788a01abb+12:2394:x1875726202674304:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788832226.225961:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10343:1875726218443264:192.168.203.26@tcp:105: 00010000:00010000:0.0:1788832226.225981:0:10343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832226.226045:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:352fff76-09db-42cd-818a-16e788a01abb+12:2393:x1875726202674176:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 9652us (9799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832226.226054:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 100 00000100:00100000:2.0:1788832226.228016:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:352fff76-09db-42cd-818a-16e788a01abb+13:2394:x1875726202674304:12345-192.168.203.26@tcp:4:lhsmtool_posix.0 Request processed in 3280us (4048us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788832226.228029:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00002000:00100000:2.0:1788832226.228041:0:8446:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9d2b084f6300 x1875726202674304/t4294967322(0) o4->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:167/0 lens 504/448 e 0 to 0 dl 1788832237 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788832226.228071:0:8446:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2b084f6300 with x1875726202674304 ext(0->12) 00002000:00010000:2.0:1788832226.228078:0:8446:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d2b084f6300 00000100:00100000:2.0:1788832226.231788:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832226.231896:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202674432 00000100:00100000:0.0:1788832226.231906:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202674432 00000100:00100000:0.0:1788832226.231966:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 244 00000100:00100000:0.0:1788832226.231976:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+73:12482:x1875726202674432:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788832226.234593:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:0.0:1788832226.234609:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1788832226.234667:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1788832226.234687:0:6504:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d2c089edf00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788832226.234692:0:6504:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d2c282b0300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d2c032fb600 00000020:00080000:0.0:1788832226.234695:0:6504:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d2c282b0e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d2b066e3c00 00000004:00080000:0.0:1788832226.234713:0:6504:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1788832226.234734:0:6504:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d2c404b0240 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788832226.234736:0:6504:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d2c0a265d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d2c404b03c0 00000020:00080000:0.0:1788832226.234739:0:6504:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d2c0a265200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d2b08530c00 00000100:00100000:0.0:1788832226.234887:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+27:12482:x1875726202674432:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 Request processed in 2907us (3104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832226.234896:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 244 00010000:00010000:2.0:1788832226.235412:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537cc8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235424:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537cc8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235431:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537cc8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235436:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0cc00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832226.235441:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537cc8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235448:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537cc8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235464:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d2c36bdbf00) 00010000:00010000:2.0:1788832226.235467:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832226.235473:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537cc8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235479:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537cc8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235513:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235535:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d70 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235541:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235546:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832226.235549:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235555:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d70 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235564:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d2b073ad700) 00010000:00010000:2.0:1788832226.235566:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832226.235570:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d70 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235574:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283537d70 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235602:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537dee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235609:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537dee lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235615:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537dee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235660:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cffa00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832226.235670:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537dee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235676:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537dee lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235687:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2b073ad400) 00010000:00010000:2.0:1788832226.235690:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832226.235692:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537dee lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235698:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b283537dee lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8742 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235711:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537e11 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235717:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537e11 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235723:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537e11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235728:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0dc00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832226.235731:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537e11 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235737:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537e11 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235745:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2b073ad400) 00010000:00010000:2.0:1788832226.235747:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832226.235757:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537e11 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235763:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0dc00/0x998c12b283537e11 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235780:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537ee3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235785:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537ee3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235791:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537ee3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235796:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832226.235799:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537ee3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235805:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537ee3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235813:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:2.0:1788832226.235815:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832226.235818:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537ee3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235823:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c800/0x998c12b283537ee3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235835:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229e00/0x998c12b283537fa0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235840:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229e00/0x998c12b283537fa0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235852:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229e00/0x998c12b283537fa0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235857:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01229e00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832226.235860:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229e00/0x998c12b283537fa0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235867:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229e00/0x998c12b283537fa0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235876:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:2.0:1788832226.235878:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788832226.235880:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229e00/0x998c12b283537fa0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.235886:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229e00/0x998c12b283537fa0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832226.235906:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832226.235924:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218443392:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788832226.235984:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832226.236022:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832226.236030:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218443520:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788832226.236054:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832226.236081:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218443392 00000100:00100000:2.0:1788832226.236088:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218443392 00000100:00100000:2.0:1788832226.236132:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218443520 00000100:00100000:2.0:1788832226.236135:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218443520 00000100:00100000:2.0:1788832226.236154:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788832226.236162:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3653:x1875726218443392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788832226.236207:0:10099:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1788832226.236230:0:10099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a7650a4/0x998c12b283537fca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.236251:0:10099:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c238400f/0x998c12b283537d7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0493c expref: 12 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.236260:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1788832226.236264:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832226.236269:0:10099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a7650a4/0x998c12b283537fca lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.236297:0:10099:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c238400f/0x998c12b283537d7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0493c expref: 12 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.236310:0:10099:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c238400f/0x998c12b283537d7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0493c expref: 12 pid: 10099 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832226.236322:0:10099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10099:1875726218443648:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788832226.236373:0:10099:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376180 going to sleep for 11 seconds 00000100:00080000:2.0:1788832226.236385:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832226.236398:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788832226.236405:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3652:x1875726218443520:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788832226.236505:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788832226.236508:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788832226 00002000:00010000:2.0:1788832226.236510:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788832226.236518:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788832226 -> 1788832226 00002000:00010000:2.0:1788832226.236520:0:8442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788832226.236558:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3652:x1875726218443520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 154us (503us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788832226.236565:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:2.0:1788832226.236616:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d2b0857ce00/2, rc 0, transno 4294967323 00000100:00100000:2.0:1788832226.236650:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218443520:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1788832226.236895:0:6557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788832226.236934:0:6557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788832226.237021:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788832226.237033:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218443776:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788832226.237067:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832226.237143:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218443776 00000100:00100000:3.0:1788832226.237148:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218443776 00000100:00100000:3.0:1788832226.237204:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788832226.237212:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3651:x1875726218443776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788832226.237228:0:10097:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:3.0:1788832226.237252:0:10097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f69e0, atime: 0x6a9f69e1, ctime: 0x6a9f69e0, blocks: 0x8 00010000:00010000:3.0:1788832226.237266:0:10097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021e38baf/0x998c12b283537fd1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.237277:0:10097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=366s v=(0 0) 00010000:00010000:3.0:1788832226.237280:0:10097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832226.237286:0:10097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021e38baf/0x998c12b283537fd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.237301:0:10097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021e38baf/0x998c12b283537fd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.237311:0:10097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021e38baf/0x998c12b283537fd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.237319:0:10097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021e38baf/0x998c12b283537fd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.237336:0:10097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788832226.237449:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3651:x1875726218443776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 237us (380us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788832226.237455:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:3.0:1788832226.237475:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832226.237482:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021e38baf/0x998c12b283537fd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.237489:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2400 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:3.0:1788832226.237493:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021e38baf/0x998c12b283537fd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.237508:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021e38baf/0x998c12b283537fd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.237524:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021e38baf/0x998c12b283537fd1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.237532:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021e38baf/0x998c12b283537fd1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.237548:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832226.237550:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832226.237552:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788832226.237576:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d2b07e2c700/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788832226.237592:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218443776:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1788832226.238728:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788832226.249190:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832226.249316:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832226.249407:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202674560 00000100:00100000:0.0:1788832226.249416:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202674560 00000100:00100000:0.0:1788832226.249469:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 77 00000100:00100000:0.0:1788832226.249479:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+13:2393:x1875726202674560:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788832226.249686:0:10099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10099:1875726218443648:192.168.203.26@tcp:104: 00010000:00010000:1.0:1788832226.249711:0:10099:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a7650a4/0x998c12b283537fca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788832226.253452:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1788832226.253467:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:0.0:1788832226.253703:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+8:2393:x1875726202674560:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 Request processed in 4220us (4534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832226.253715:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 77 00000100:00100000:3.0:1788832226.255717:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202674688 00000100:00100000:3.0:1788832226.255734:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202674688 00010000:00010000:2.0:1788832226.255876:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c238400f/0x998c12b283537d7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0493c expref: 8 pid: 10099 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832226.255927:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 101 00000100:00100000:2.0:1788832226.255937:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+8:2393:x1875726202674688:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832226.255953:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832226.255958:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c238400f/0x998c12b283537d7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0493c expref: 8 pid: 10099 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.255971:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c238400f/0x998c12b283537d7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0493c expref: 8 pid: 10099 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.255995:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c238400f/0x998c12b283537d7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0493c expref: 8 pid: 10099 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.256032:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832226.256037:0:6510:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832226.256042:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a7650a4/0x998c12b283537fca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.256051:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a7650a4/0x998c12b283537fca lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.256137:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832226.256210:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+7:2393:x1875726202674688:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 274us (6893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832226.256218:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 101 00000100:00100000:2.0:1788832226.259203:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832226.260419:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202674944 00000100:00100000:3.0:1788832226.260432:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202674944 00000100:00100000:3.0:1788832226.260499:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 245 00000100:00100000:3.0:1788832226.260509:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+21:12482:x1875726202674944:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788832226.260562:0:6525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832226.260598:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229600/0x998c12b283537fb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049d6 expref: 21 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.260617:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:3.0:1788832226.260668:0:6525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788832226.260699:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537fd8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.260713:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.260724:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788832226.260844:0:6525:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce53752a reply state 00000000a2e646fc transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.260857:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537fd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.260863:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:3.0:1788832226.260866:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788832226.260868:0:6525:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788832226.260971:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+22:12482:x1875726202674944:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 462us (1775us total) trans 4294967510 rc 0/0 00000100:00100000:3.0:1788832226.260979:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 245 00010000:00010000:1.0:1788832226.261255:0:10099:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a7650a4/0x998c12b283537fca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.261266:0:10099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a7650a4/0x998c12b283537fca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.261275:0:10099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a7650a4/0x998c12b283537fca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.263233:0:10099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a7650a4/0x998c12b283537fca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.263265:0:10099:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832226.263301:0:13191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832226.263312:0:13191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a7650a4/0x998c12b283537fca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.263321:0:13191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01229000 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832226.263325:0:13191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a7650a4/0x998c12b283537fca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.263334:0:13191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a7650a4/0x998c12b283537fca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.263355:0:13191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a7650a4/0x998c12b283537fca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.263375:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a7650a4/0x998c12b283537fca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.263398:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832226.263399:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832226.263401:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832226.264250:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3653:x1875726218443392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28083us (28260us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788832226.264261:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788832226.266717:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832226.266833:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202675072 00000100:00100000:3.0:1788832226.266845:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202675072 00000100:00100000:3.0:1788832226.266898:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 78 00000100:00100000:3.0:1788832226.266908:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+7:2393:x1875726202675072:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788832226.267061:0:10097:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788832226.267064:0:10097:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788832226 -> 1788832225 00002000:00010000:3.0:1788832226.267067:0:10097:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788832225 00002000:00010000:3.0:1788832226.267069:0:10097:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788832226 -> 1788832225 00002000:00010000:3.0:1788832226.267084:0:10097:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788832226.267140:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:352fff76-09db-42cd-818a-16e788a01abb+8:2393:x1875726202675072:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 233us (433us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788832226.267148:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 78 00000100:00100000:2.0:1788832226.269944:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:2.0:1788832226.269957:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967319 committed transno 4294967323 00000004:00080000:2.0:1788832226.269994:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d2b0857ce00, transno 4294967323 00000100:00100000:2.0:1788832226.270016:0:3653:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9d2b0857c380 x1875726218443392/t4294967324(4294967324) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788832242 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788832226.270028:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d2b0857c380/2, rc 0, transno 4294967324 00000100:00100000:2.0:1788832226.270033:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218443392:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788832226.271273:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832226.275022:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202675328 00000100:00100000:2.0:1788832226.275037:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202675328 00000100:00100000:2.0:1788832226.275103:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 246 00000100:00100000:2.0:1788832226.275114:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+22:12482:x1875726202675328:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788832226.275247:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537fdf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.275264:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b283537f99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049c8 expref: 22 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.275274:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537fdf lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.275394:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b283537f99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049c8 expref: 22 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.275410:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b283537f99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049c8 expref: 22 pid: 13811 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832226.275424:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1875726218443904:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788832226.275598:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376540 going to sleep for 11 seconds 00000100:00100000:3.0:1788832226.279028:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832226.279118:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202675456 00000100:00100000:0.0:1788832226.279127:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202675456 00010000:00010000:0.0:1788832226.279166:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b283537f99 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049c8 expref: 23 pid: 13811 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832226.279209:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 102 00000100:00100000:0.0:1788832226.279218:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+23:2393:x1875726202675456:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832226.279233:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832226.279240:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b283537f99 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049c8 expref: 23 pid: 13811 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.279253:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b283537f99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049c8 expref: 23 pid: 13811 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.279275:0:10344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:0.0:1788832226.279281:0:10344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537fdf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.279424:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537fdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.279434:0:10344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537fdf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.279466:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832226.279528:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+23:2393:x1875726202675456:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 310us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832226.279536:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 102 00010000:00010000:2.0:1788832226.279952:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b283537f99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049c8 expref: 22 pid: 13811 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832226.279971:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1875726218443904:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832226.279991:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537fdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.280000:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537fdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.280006:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537fdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.280044:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537fdf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.280051:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537fdf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.280058:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537fdf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.280073:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01228c00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832226.280078:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537fdf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.280085:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537fdf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.280095:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:2.0:1788832226.280098:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788832226.280101:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537fdf lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.280106:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537fdf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832226.280158:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+21:12482:x1875726202675328:12345-192.168.203.26@tcp:55:lhsmtool_posix.0 Request processed in 5046us (8891us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788832226.280166:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 246 00000100:00100000:3.0:1788832226.286129:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832226.287539:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202675584 00000100:00100000:0.0:1788832226.287553:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202675584 00000100:00100000:0.0:1788832226.287697:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 79 00000100:00100000:0.0:1788832226.287708:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+8:2394:x1875726202675584:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788832226.287754:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005b28b673/0x998c12b283537fe6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.287774:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283537fc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049e4 expref: 8 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.287784:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832226.287788:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788832226.287793:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b28b673/0x998c12b283537fe6 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.287830:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283537fc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049e4 expref: 8 pid: 10097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.287845:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283537fc3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049e4 expref: 8 pid: 10097 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832226.287859:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8440:1875726218444032:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788832226.287965:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b0720d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788832226.291127:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8440:1875726218444032:192.168.203.26@tcp:104: 00010000:00010000:1.0:1788832226.291158:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005b28b673/0x998c12b283537fe6 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832226.293323:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832226.293525:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202675712 00000100:00100000:1.0:1788832226.293535:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202675712 00010000:00010000:1.0:1788832226.293574:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283537fc3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049e4 expref: 9 pid: 10097 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832226.293653:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 103 00000100:00100000:1.0:1788832226.293664:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+9:2394:x1875726202675712:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832226.293681:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832226.293703:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283537fc3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049e4 expref: 9 pid: 10097 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.293717:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283537fc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049e4 expref: 9 pid: 10097 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.293761:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283537fc3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049e4 expref: 9 pid: 10097 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.293780:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788832226.293785:0:6511:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788832226.293791:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005b28b673/0x998c12b283537fe6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.293800:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b28b673/0x998c12b283537fe6 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.293837:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832226.293894:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+8:2394:x1875726202675712:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 232us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832226.293901:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 103 00010000:00010000:2.0:1788832226.293981:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005b28b673/0x998c12b283537fe6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.293990:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b28b673/0x998c12b283537fe6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.294010:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005b28b673/0x998c12b283537fe6 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.294018:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b28b673/0x998c12b283537fe6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.294032:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b28b673/0x998c12b283537fe6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.294039:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c800 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832226.294044:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b28b673/0x998c12b283537fe6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.294053:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b28b673/0x998c12b283537fe6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.294065:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b28b673/0x998c12b283537fe6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.294072:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b28b673/0x998c12b283537fe6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832226.294123:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+7:2394:x1875726202675584:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 Request processed in 6417us (8007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832226.294130:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 79 00000100:00100000:0.0:1788832226.298244:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832226.298344:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202675968 00000100:00100000:2.0:1788832226.298355:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202675968 00000100:00100000:2.0:1788832226.298414:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 247 00000100:00100000:2.0:1788832226.298425:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+21:12482:x1875726202675968:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788832226.298497:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229000/0x998c12b283537fed lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.298526:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537edc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04990 expref: 21 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.298537:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229000/0x998c12b283537fed lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.298573:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537edc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04990 expref: 21 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.298598:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537edc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04990 expref: 21 pid: 13811 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832226.298613:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1875726218444160:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788832226.298721:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376540 going to sleep for 11 seconds 00000100:00100000:3.0:1788832226.302351:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832226.302505:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202676096 00000100:00100000:0.0:1788832226.302514:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202676096 00010000:00010000:0.0:1788832226.302554:0:6510:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537edc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04990 expref: 22 pid: 13811 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832226.302602:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 104 00000100:00100000:0.0:1788832226.302722:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+22:2393:x1875726202676096:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832226.302739:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832226.302746:0:6510:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537edc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04990 expref: 22 pid: 13811 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.302757:0:6510:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537edc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04990 expref: 22 pid: 13811 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.302783:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:0.0:1788832226.302790:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2400/0x998c12b283537f3e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049b3 expref: 22 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.302800:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229000/0x998c12b283537fed lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.302811:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229000/0x998c12b283537fed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.302821:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229000/0x998c12b283537fed lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.302859:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832226.302916:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+22:2393:x1875726202676096:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 305us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832226.302923:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 104 00010000:00010000:2.0:1788832226.304125:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031e00/0x998c12b283537edc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04990 expref: 21 pid: 13811 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832226.304149:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1875726218444160:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832226.304279:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229000/0x998c12b283537fed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.304941:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229000/0x998c12b283537fed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.304951:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229000/0x998c12b283537fed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.305120:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537ff4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.305134:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537fa7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049cf expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.305142:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537ff4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.305496:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537fa7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049cf expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.305512:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537fa7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049cf expref: 21 pid: 6525 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832226.305527:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1875726218444288:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788832226.306027:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b0720dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788832226.311107:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1875726218444288:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788832226.311154:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537ff4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832226.313854:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832226.314008:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202676224 00000100:00100000:0.0:1788832226.314019:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202676224 00010000:00010000:0.0:1788832226.314059:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537fa7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049cf expref: 22 pid: 6525 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832226.314138:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 105 00000100:00100000:0.0:1788832226.314149:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c09479450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+22:2394:x1875726202676224:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832226.314174:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832226.314182:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537fa7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049cf expref: 22 pid: 6525 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.314203:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537fa7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049cf expref: 22 pid: 6525 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.314226:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff400/0x998c12b283537fa7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049cf expref: 22 pid: 6525 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.314243:0:10344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:0.0:1788832226.314249:0:10344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537ff4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.314258:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537ff4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.314265:0:10344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537ff4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832226.314326:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832226.314381:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c09479450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:352fff76-09db-42cd-818a-16e788a01abb+21:2394:x1875726202676224:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 233us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832226.314389:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 105 00010000:00010000:1.0:1788832226.314467:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537ff4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832226.314475:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537ff4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788832226.314590:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1788832226.314724:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:1.0:1788832226.314763:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1788832226.314842:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6526:1875726218444416:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788832226.315129:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832226.315173:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c05596cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832226.315677:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218444416 00000100:00100000:2.0:1788832226.315686:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218444416 00000100:00100000:2.0:1788832226.315737:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788832226.315747:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6526:x1875726218444416:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788832226.315841:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6526:x1875726218444416:12345-0@lo:1000:mdt00_001.0 Request processed in 96us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832226.315857:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788832226.315920:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6526:1875726218444416:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788832226.316080:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:2.0:1788832226.316137:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6526:1875726218444544:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788832226.316188:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832226.316214:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218444544 00000100:00100000:2.0:1788832226.316218:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218444544 00000100:00100000:2.0:1788832226.316242:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788832226.316249:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6526:x1875726218444544:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788832226.316654:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6526:x1875726218444544:12345-0@lo:1000:mdt00_001.0 Request processed in 404us (464us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788832226.316661:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788832226.316682:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c028ddf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788832226.316702:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6526:1875726218444544:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788832226.316735:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537ff4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.316744:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537ff4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.316751:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537ff4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.316756:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0cc00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832226.316760:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537ff4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.316767:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537ff4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.316794:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:2.0:1788832226.316797:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788832226.316802:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537ff4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.316807:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283537ff4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.316833:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2800/0x998c12b283537f37 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.316839:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2800/0x998c12b283537f37 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.316844:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2800/0x998c12b283537f37 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.316849:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c390f2800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832226.316851:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2800/0x998c12b283537f37 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.316856:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2800/0x998c12b283537f37 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.316863:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:2.0:1788832226.316865:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788832226.316872:0:6526:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2400/0x998c12b283537f3e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049b3 expref: 24 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.317055:0:6526:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2400/0x998c12b283537f3e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049b3 expref: 24 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.317072:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2400/0x998c12b283537f3e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049b3 expref: 24 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.317103:0:6526:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2400/0x998c12b283537f3e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049b3 expref: 24 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832226.317114:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1875726218444672:192.168.203.26@tcp:105: 00000100:00100000:2.0:1788832226.317169:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c055800c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832226.321153:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832226.321283:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6526:1875726218444672:192.168.203.26@tcp:105: 00010000:00010000:2.0:1788832226.321489:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2800/0x998c12b283537f37 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.321498:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2800/0x998c12b283537f37 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.321532:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537ffb lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.321546:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537ffb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.321556:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537ffb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.321566:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537ffb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.321571:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537ffb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.321601:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537ffb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.321606:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01228c00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832226.321610:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537ffb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.321617:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537ffb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.321655:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:2.0:1788832226.321658:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832226.321661:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537ffb lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.321667:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283537ffb lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.321678:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229000/0x998c12b283537fed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.321685:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229000/0x998c12b283537fed lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.321690:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229000/0x998c12b283537fed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.321695:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01229000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832226.321698:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229000/0x998c12b283537fed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.321713:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229000/0x998c12b283537fed lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.321722:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:2.0:1788832226.321724:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788832226.321728:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229000/0x998c12b283537fed lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.321733:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229000/0x998c12b283537fed lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832226.322036:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202676352 00000100:00100000:1.0:1788832226.322044:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202676352 00000100:00100000:1.0:1788832226.322098:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:1.0:1788832226.322107:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+25:12481:x1875726202676352:12345-192.168.203.26@tcp:49:lfs.0 00000100:00100000:1.0:1788832226.322466:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+25:12481:x1875726202676352:12345-192.168.203.26@tcp:49:lfs.0 Request processed in 359us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832226.322474:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 61 00000040:00080000:2.0:1788832226.323604:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788832226.323610:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788832226.324165:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788832226.324188:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788832226.325668:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+24:12482:x1875726202675968:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 27233us (27423us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788832226.325681:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 247 00000020:00080000:2.0:1788832226.325688:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788832226.330575:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832226.330742:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832226.331110:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202676864 00000100:00100000:3.0:1788832226.331121:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202676864 00000100:00100000:3.0:1788832226.331196:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 62 00000100:00100000:3.0:1788832226.331207:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c099bfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+24:12482:x1875726202676864:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788832226.331479:0:6529:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788832226.331514:0:6529:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:3.0:1788832226.331546:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283538002 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.331564:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283538002 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.331576:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283538002 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.331595:0:6529:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283538002 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.331602:0:6529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283538002 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.331658:0:6529:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283538002 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.331678:0:6529:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788832226.331768:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c099bfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+26:12482:x1875726202676864:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 561us (1024us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788832226.331777:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 62 00000020:00080000:3.0:1788832226.331782:0:6529:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788832226.331990:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832226.331997:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283538002 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.332004:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d3000 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832226.332008:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283538002 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.332015:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283538002 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.332039:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:2.0:1788832226.332042:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788832226.332048:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283538002 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.332053:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b283538002 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6529 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.332065:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832226.332066:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832226.332068:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832226.334082:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202676608 00000100:00100000:0.0:1788832226.334097:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202676608 00000100:00100000:0.0:1788832226.334246:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 248 00000100:00100000:0.0:1788832226.334258:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+26:12481:x1875726202676608:12345-192.168.203.26@tcp:58:lfs.0 00000040:00080000:0.0:1788832226.334541:0:13811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788832226.334664:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+26:12481:x1875726202676608:12345-192.168.203.26@tcp:58:lfs.0 Request processed in 408us (4097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832226.334673:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 248 00000100:00100000:1.0:1788832226.373493:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832226.373616:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202676992 00000100:00100000:2.0:1788832226.373667:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202676992 00000100:00100000:2.0:1788832226.373734:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 249 00000100:00100000:2.0:1788832226.373745:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+26:12484:x1875726202676992:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788832226.373769:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832226.373790:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229000/0x998c12b283538009 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc049eb expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.373855:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283538010 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.373870:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283538010 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.373891:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283538010 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.373907:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b283538017 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.373928:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b283538017 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.373935:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b283538017 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.374008:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228a00/0x998c12b28353801e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.374018:0:6527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537f29 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049ac expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.374027:0:6527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228a00/0x998c12b28353801e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.374059:0:6527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537f29 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049ac expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.374072:0:6527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537f29 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049ac expref: 27 pid: 6525 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832226.374086:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1875726218444800:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788832226.374169:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c055800c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832226.377694:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6527:1875726218444800:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832226.377723:0:6527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228a00/0x998c12b28353801e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832226.379402:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832226.379547:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202677248 00000100:00100000:3.0:1788832226.379557:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202677248 00000100:00100000:3.0:1788832226.379655:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:3.0:1788832226.379666:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+28:6165:x1875726202677248:12345-192.168.203.26@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788832226.379876:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+29:6165:x1875726202677248:12345-192.168.203.26@tcp:35:ldlm_bl.0 Request processed in 211us (479us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788832226.379896:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:1.0:1788832226.382686:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832226.382868:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202677376 00000100:00100000:3.0:1788832226.382879:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202677376 00010000:00010000:3.0:1788832226.382926:0:6511:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537f29 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049ac expref: 29 pid: 6525 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832226.382966:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 106 00000100:00100000:3.0:1788832226.382976:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+29:2393:x1875726202677376:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832226.382990:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832226.382997:0:6511:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537f29 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049ac expref: 29 pid: 6525 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.383030:0:6511:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537f29 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049ac expref: 29 pid: 6525 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.383051:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3400/0x998c12b283537f29 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049ac expref: 29 pid: 6525 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.383067:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:3.0:1788832226.383073:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228a00/0x998c12b28353801e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.383081:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228a00/0x998c12b28353801e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.383090:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228a00/0x998c12b28353801e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832226.383121:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788832226.383340:0:6527:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228a00/0x998c12b28353801e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.383355:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228a00/0x998c12b28353801e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832226.383405:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788832226.383410:0:6527:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788832226.383429:0:6527:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228a00/0x998c12b28353801e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.383441:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228a00/0x998c12b28353801e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.383450:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283538010 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.383456:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283538010 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.383463:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283538010 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.383468:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01228c00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832226.383472:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283538010 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.383480:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283538010 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.383489:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:2.0:1788832226.383492:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832226.383495:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283538010 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.383514:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228c00/0x998c12b283538010 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.383526:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b283538017 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.383532:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b283538017 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.383538:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b283538017 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.383543:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01229a00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832226.383546:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b283538017 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.383552:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b283538017 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.383559:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d2c36bdbc00) 00010000:00010000:2.0:1788832226.383562:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832226.383565:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b283538017 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.383571:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b283538017 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.383617:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229000/0x998c12b283538009 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049eb expref: 29 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.383670:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228a00/0x998c12b28353801e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049eb expref: 28 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832226.383684:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:2.0:1788832226.383686:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832226.383688:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c01228a00, rc 0) 00000100:00100000:3.0:1788832226.383933:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:352fff76-09db-42cd-818a-16e788a01abb+28:2393:x1875726202677376:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 956us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832226.383941:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 106 00000100:00100000:2.0:1788832226.385028:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+27:12484:x1875726202676992:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 11277us (11538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832226.385039:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 249 00010000:00010000:0.0:1788832226.777384:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832227.031478:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788832227.031501:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218444928:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832227.031582:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832227.031668:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218444928 00000100:00100000:3.0:1788832227.031676:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218444928 00000100:00100000:3.0:1788832227.031732:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788832227.031742:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218444928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788832227.031777:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788832227.031835:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218444928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832227.031856:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788832227.031935:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218444928:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788832227.192541:0:14814:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788832227.192550:0:14814:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832227.192594:0:14814:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788832227.192601:0:14814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788832227.353128:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788832227.353136:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788832227.353160:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788832227.353166:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788832227.353319:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875726218445056:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788832227.353416:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c05596000 going to sleep for 11 seconds 00000100:00100000:3.0:1788832227.361529:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832227.361610:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1875726218445056:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788832227.362702:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202677504 00000100:00100000:3.0:1788832227.362713:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202677504 00000100:00100000:3.0:1788832227.362781:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 250 00000100:00100000:3.0:1788832227.362792:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+27:12496:x1875726202677504:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788832227.362831:0:6526:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788832227.362952:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+27:12496:x1875726202677504:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 162us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832227.362960:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 250 00000100:00080000:3.0:1788832227.362984:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832227.367448:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832227.367603:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202677760 00000100:00100000:2.0:1788832227.367615:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202677760 00000100:00100000:2.0:1788832227.367696:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 251 00000100:00100000:2.0:1788832227.367706:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+27:12496:x1875726202677760:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788832227.367731:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832227.367755:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229c00/0x998c12b283538025 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc049f2 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832227.367880:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229800/0x998c12b28353802c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832227.367896:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229800/0x998c12b28353802c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832227.367911:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229800/0x998c12b28353802c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832227.367937:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788832227.368043:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229c00/0x998c12b283538025 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049f2 expref: 30 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832227.368061:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229800/0x998c12b28353802c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049f2 expref: 29 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832227.368070:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:2.0:1788832227.368073:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832227.368076:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c01229800, rc 0) 00000100:00100000:2.0:1788832227.368135:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+29:12496:x1875726202677760:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 431us (698us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788832227.368142:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 251 00000100:00100000:2.0:1788832227.373434:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832227.373510:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202678016 00000100:00100000:1.0:1788832227.373520:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202678016 00000100:00100000:1.0:1788832227.373591:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 252 00000100:00100000:1.0:1788832227.373603:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+29:12496:x1875726202678016:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788832227.373729:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b28353803a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832227.373748:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b28353803a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832227.373772:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b28353803a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832227.373928:0:6527:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b28353803a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832227.373936:0:6527:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b28353803a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832227.373943:0:6527:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b28353803a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832227.373949:0:6527:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832227.373953:0:6527:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b28353803a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832227.373960:0:6527:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b28353803a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832227.373973:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:1.0:1788832227.373976:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788832227.373980:0:6527:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b28353803a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832227.373987:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff600/0x998c12b28353803a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832227.374105:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+30:12496:x1875726202678016:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 504us (681us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788832227.374114:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 252 00000040:00080000:2.0:1788832227.374282:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788832227.374298:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788832227.374823:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788832227.374834:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788832227.383884:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832227.383912:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832227.383940:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202678400 00000100:00100000:1.0:1788832227.383948:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202678400 00000100:00100000:1.0:1788832227.384001:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:1.0:1788832227.384009:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+30:2393:x1875726202678400:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832227.384023:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832227.384046:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229800/0x998c12b28353802c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049f2 expref: 30 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832227.384064:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:1.0:1788832227.384068:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832227.384114:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:352fff76-09db-42cd-818a-16e788a01abb+29:2393:x1875726202678400:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 106us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832227.384121:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:3.0:1788832227.385720:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202678272 00000100:00100000:3.0:1788832227.385731:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202678272 00000100:00100000:3.0:1788832227.385786:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:3.0:1788832227.385794:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+29:12496:x1875726202678272:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788832227.385991:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+30:12496:x1875726202678272:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 197us (2115us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788832227.385999:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:2.0:1788832227.542963:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218445184:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788832227.543040:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832227.543188:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218445184 00000100:00100000:1.0:1788832227.543196:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218445184 00000100:00100000:1.0:1788832227.543247:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788832227.543256:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218445184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788832227.543287:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788832227.543342:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218445184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832227.543350:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788832227.543398:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218445184:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788832227.800913:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832228.055821:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832228.055847:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218445312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832228.055921:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832228.056334:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218445568:0@lo:400:kworker.0 00000100:00100000:3.0:1788832228.056375:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832228.056397:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218446080:0@lo:400:kworker.0 00000100:00100000:3.0:1788832228.056417:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832228.056453:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218446592:0@lo:400:kworker.0 00000100:00100000:3.0:1788832228.056476:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832228.056495:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788832228.056500:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218445696:0@lo:400:kworker.0 00000100:00100000:3.0:1788832228.056522:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832228.056538:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218446208:0@lo:400:kworker.0 00000100:00100000:3.0:1788832228.056555:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832228.056585:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07dded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218446720:0@lo:400:kworker.0 00000100:00100000:3.0:1788832228.056605:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832228.056655:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218445696 00000100:00100000:3.0:1788832228.056662:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218445696 00000100:00100000:3.0:1788832228.056704:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788832228.056712:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218445696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832228.056830:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218445696:12345-0@lo:400:kworker.0 Request processed in 118us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832228.056837:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788832228.056860:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218445568 00000100:00100000:3.0:1788832228.056864:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218445568 00000100:00100000:3.0:1788832228.056881:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218446080 00000100:00100000:3.0:1788832228.056884:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218446080 00000100:00100000:3.0:1788832228.056906:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218446592 00000100:00100000:3.0:1788832228.056908:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218446592 00000100:00100000:3.0:1788832228.056921:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218446208 00000100:00100000:3.0:1788832228.056923:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218446208 00000100:00100000:1.0:1788832228.057021:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218445824:0@lo:400:kworker.0 00000100:00100000:1.0:1788832228.057052:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832228.057074:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218446336:0@lo:400:kworker.0 00000100:00100000:1.0:1788832228.057096:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832228.057112:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218446848:0@lo:400:kworker.0 00000100:00100000:1.0:1788832228.057131:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832228.057151:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788832228.057157:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218445440:0@lo:400:kworker.0 00000100:00100000:1.0:1788832228.057183:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832228.057205:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218445952:0@lo:400:kworker.0 00000100:00100000:1.0:1788832228.057224:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832228.057237:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218446464:0@lo:400:kworker.0 00000100:00100000:1.0:1788832228.057255:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832228.057278:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218446336 00000100:00100000:1.0:1788832228.057281:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218446336 00000100:00100000:1.0:1788832228.057306:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218446848 00000100:00100000:1.0:1788832228.057309:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218446848 00000100:00100000:1.0:1788832228.057327:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218446464 00000100:00100000:1.0:1788832228.057329:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218446464 00000100:00100000:1.0:1788832228.057343:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788832228.057350:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218446336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832228.057387:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218446336:12345-0@lo:400:kworker.0 Request processed in 37us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832228.057392:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788832228.057404:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788832228.057410:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218446848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832228.057435:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218446848:12345-0@lo:400:kworker.0 Request processed in 25us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832228.057441:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788832228.057459:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788832228.057465:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3651:x1875726218446464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832228.057494:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3651:x1875726218446464:12345-0@lo:400:kworker.0 Request processed in 30us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832228.057500:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788832228.057517:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218445440 00000100:00100000:1.0:1788832228.057520:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218445440 00000100:00100000:1.0:1788832228.057542:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1788832228.057548:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218445440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832228.057585:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218445440:12345-0@lo:400:kworker.0 Request processed in 38us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832228.057591:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1788832228.057636:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218445952 00000100:00100000:1.0:1788832228.057639:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218445952 00000100:00100000:1.0:1788832228.057662:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788832228.057668:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218445952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832228.057696:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218445952:12345-0@lo:400:kworker.0 Request processed in 29us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832228.057701:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788832228.057738:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218445440:0@lo:400:kworker.0 00000100:00100000:1.0:1788832228.057763:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218445952:0@lo:400:kworker.0 00000100:00100000:1.0:1788832228.057774:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218446464:0@lo:400:kworker.0 00000100:00100000:1.0:1788832228.057782:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218446336:0@lo:400:kworker.0 00000100:00100000:1.0:1788832228.057790:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218446848:0@lo:400:kworker.0 00000100:00100000:1.0:1788832228.057848:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218446720 00000100:00100000:1.0:1788832228.057851:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218446720 00000100:00100000:1.0:1788832228.057869:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218445824 00000100:00100000:1.0:1788832228.057872:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218445824 00000100:00100000:1.0:1788832228.057886:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788832228.057892:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218445568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832228.057924:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218445568:12345-0@lo:400:kworker.0 Request processed in 33us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832228.057930:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788832228.058098:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788832228.058106:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218446080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832228.058142:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218446080:12345-0@lo:400:kworker.0 Request processed in 38us (1724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832228.058157:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788832228.058173:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788832228.058179:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218446592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832228.058221:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218446592:12345-0@lo:400:kworker.0 Request processed in 42us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832228.058226:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788832228.058240:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788832228.058246:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218446208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832228.058273:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218446208:12345-0@lo:400:kworker.0 Request processed in 29us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832228.058278:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788832228.058290:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788832228.058295:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218446720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832228.058322:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218446720:12345-0@lo:400:kworker.0 Request processed in 27us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832228.058341:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788832228.058353:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788832228.058359:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218445824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832228.058392:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218445824:12345-0@lo:400:kworker.0 Request processed in 33us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832228.058397:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00080000:3.0:1788832228.058417:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788832228.058421:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788832228.058424:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788832228.058426:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832228.058455:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218445824:0@lo:400:kworker.0 00000100:00100000:3.0:1788832228.058492:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218445696:0@lo:400:kworker.0 00010000:00080000:3.0:1788832228.058507:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07e2d180 x1875726218446208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832228.058517:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218446208:0@lo:400:kworker.0 00010000:00080000:3.0:1788832228.058527:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07dded80 x1875726218446720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832228.058535:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07dded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218446720:0@lo:400:kworker.0 00000100:00100000:3.0:1788832228.058545:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218445568:0@lo:400:kworker.0 00000100:00100000:3.0:1788832228.058555:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218446080:0@lo:400:kworker.0 00000100:00100000:3.0:1788832228.058576:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218446592:0@lo:400:kworker.0 00000100:00100000:0.0:1788832228.059160:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218445312 00000100:00100000:0.0:1788832228.059168:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218445312 00000100:00100000:0.0:1788832228.059230:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788832228.059237:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1875726218445312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788832228.059259:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788832228.059318:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1875726218445312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (3397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832228.059325:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788832228.059453:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218445312:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788832228.061359:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1788832228.251817:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788832228.566786:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832228.566817:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218446976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788832228.566883:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832228.566971:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218446976 00000100:00100000:2.0:1788832228.566979:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218446976 00000100:00100000:2.0:1788832228.567025:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788832228.567035:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218446976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788832228.567642:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788832228.567699:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218446976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 665us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832228.567708:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788832228.567765:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218446976:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788832228.824263:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788832229.024552:0:14866:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788832229.024571:0:14866:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788832229.024602:0:14866:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788832229.024608:0:14866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788832229.083512:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07dded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218447104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832229.083611:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832229.084117:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218447104 00000100:00100000:3.0:1788832229.084126:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218447104 00000100:00100000:3.0:1788832229.084189:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788832229.084199:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218447104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788832229.084228:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788832229.084294:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218447104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832229.084301:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788832229.084464:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07dded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218447104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788832229.165414:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832229.165509:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202678656 00000100:00100000:0.0:1788832229.165518:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202678656 00000100:00100000:0.0:1788832229.165597:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 253 00000100:00100000:0.0:1788832229.165608:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+30:12516:x1875726202678656:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1788832229.165659:0:6527:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832229.165682:0:6527:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c200/0x998c12b283538041 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc049f9 expref: -99 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832229.165792:0:6527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283538048 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832229.165807:0:6527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283538048 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832229.165820:0:6527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283538048 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6527 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832229.165831:0:6527:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788832229.165953:0:6527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0c200/0x998c12b283538041 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049f9 expref: 33 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832229.165972:0:6527:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283538048 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049f9 expref: 32 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832229.165980:0:6527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:0.0:1788832229.165983:0:6527:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788832229.165987:0:6527:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0d200, rc 0) 00000100:00100000:0.0:1788832229.166043:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+32:12516:x1875726202678656:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 437us (637us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788832229.166059:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 253 00000100:00080000:3.0:1788832229.166660:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832229.170081:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832229.171662:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202678784 00000100:00100000:2.0:1788832229.171675:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202678784 00000100:00100000:2.0:1788832229.171732:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 254 00000100:00100000:2.0:1788832229.171742:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+32:12516:x1875726202678784:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:2.0:1788832229.171810:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228e00/0x998c12b283538056 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832229.171827:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228e00/0x998c12b283538056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832229.171838:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228e00/0x998c12b283538056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832229.171872:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228e00/0x998c12b283538056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832229.171885:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228e00/0x998c12b283538056 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832229.171891:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228e00/0x998c12b283538056 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832229.171897:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01228e00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832229.171900:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228e00/0x998c12b283538056 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832229.171920:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228e00/0x998c12b283538056 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832229.171933:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:2.0:1788832229.171936:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788832229.171941:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228e00/0x998c12b283538056 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832229.171947:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228e00/0x998c12b283538056 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832229.172017:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:352fff76-09db-42cd-818a-16e788a01abb+32:12516:x1875726202678784:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 275us (1944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832229.172024:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 254 00000100:00100000:0.0:1788832229.318311:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832229.318396:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202678912 00000100:00100000:2.0:1788832229.318404:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202678912 00000100:00100000:2.0:1788832229.318473:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 80 00000100:00100000:2.0:1788832229.318483:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:352fff76-09db-42cd-818a-16e788a01abb+7:2396:x1875726202678912:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:2.0:1788832229.318499:0:10099:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832229.318528:0:10099:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eef0ec67/0x998c12b28353805d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04a00 expref: -99 pid: 10099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788832229.318552:0:10099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f69e1, atime: 0x6a9f69e1, ctime: 0x6a9f69e1, blocks: 0x8 00010000:00010000:2.0:1788832229.318583:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=369s v=(0 0) 00010000:00010000:2.0:1788832229.318588:0:10099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832229.318597:0:10099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eef0ec67/0x998c12b28353805d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a00 expref: 8 pid: 10099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832229.318617:0:10099:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eef0ec67/0x998c12b28353805d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a00 expref: 8 pid: 10099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832229.318657:0:10099:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c01228e00, rc 0) 00000100:00100000:2.0:1788832229.318706:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:352fff76-09db-42cd-818a-16e788a01abb+8:2396:x1875726202678912:12345-192.168.203.26@tcp:101:cat.0 Request processed in 226us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832229.318713:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 80 00000100:00080000:3.0:1788832229.318794:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832229.327547:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832229.327709:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202679040 00000100:00100000:1.0:1788832229.327718:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202679040 00002000:00100000:1.0:1788832229.327768:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9d2b084f5180 x1875726202679040/t0(0) o3->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:170/0 lens 488/0 e 0 to 0 dl 1788832240 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788832229.327781:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2b084f5180 with x1875726202679040 ext(0->4095) 00002000:00010000:1.0:1788832229.327786:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d2b084f5180 00000100:00100000:1.0:1788832229.327816:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:1.0:1788832229.327826:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:352fff76-09db-42cd-818a-16e788a01abb+8:2395:x1875726202679040:12345-192.168.203.26@tcp:3:cat.0 00000100:00100000:1.0:1788832229.328026:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:352fff76-09db-42cd-818a-16e788a01abb+8:2395:x1875726202679040:12345-192.168.203.26@tcp:3:cat.0 Request processed in 199us (488us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788832229.328034:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 8 00002000:00100000:1.0:1788832229.328040:0:8447:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9d2b084f5180 x1875726202679040/t0(0) o3->352fff76-09db-42cd-818a-16e788a01abb@192.168.203.26@tcp:170/0 lens 488/4536 e 0 to 0 dl 1788832240 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788832229.328066:0:8447:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9d2b084f5180 with x1875726202679040 ext(0->4095) 00002000:00010000:1.0:1788832229.328070:0:8447:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d2b084f5180 00000100:00100000:0.0:1788832229.591649:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218447232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788832229.591728:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832229.591882:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218447232 00000100:00100000:3.0:1788832229.591891:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218447232 00000100:00100000:3.0:1788832229.591947:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788832229.591957:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1875726218447232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788832229.591979:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788832229.592035:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1875726218447232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832229.592044:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788832229.592375:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218447232:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788832229.847266:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832230.102266:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832230.102369:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832230.102398:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832230.102470:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202679552 00000100:00100000:0.0:1788832230.102483:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202679552 00000100:00100000:0.0:1788832230.103471:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 136 00000100:00100000:0.0:1788832230.103496:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+8:2394:x1875726202679552:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832230.103649:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+8:2394:x1875726202679552:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 159us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832230.103659:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 136 00000001:00080000:2.0:1788832230.105999:0:9518:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:1.0:1788832230.108146:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202679296 00000100:00100000:1.0:1788832230.108225:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202679296 00000100:00100000:1.0:1788832230.108376:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202679808 00000100:00100000:1.0:1788832230.108381:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202679808 00000100:00100000:2.0:1788832230.108523:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 327 00000100:00100000:2.0:1788832230.108539:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+32:2394:x1875726202679296:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832230.108709:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+32:2394:x1875726202679296:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 174us (6457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832230.108717:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 327 00000100:00100000:2.0:1788832230.108739:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 328 00000100:00100000:2.0:1788832230.108747:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2394:x1875726202679808:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832230.108797:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2394:x1875726202679808:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 51us (6398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832230.108804:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 328 00000100:00080000:2.0:1788832230.108847:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832230.111005:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832230.111047:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832230.111077:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832230.111736:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202679424 00000100:00100000:1.0:1788832230.111751:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202679424 00000100:00100000:2.0:1788832230.111984:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202679168 00000100:00100000:2.0:1788832230.111990:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202679168 00000100:00100000:2.0:1788832230.112036:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 389 00000100:00100000:2.0:1788832230.112049:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2394:x1875726202679168:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832230.112130:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 329 00000100:00100000:1.0:1788832230.112139:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+5:2394:x1875726202679424:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832230.112151:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2394:x1875726202679168:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 105us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832230.112160:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 389 00000100:00100000:2.0:1788832230.112212:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202679680 00000100:00100000:2.0:1788832230.112217:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202679680 00000100:00100000:1.0:1788832230.112234:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+5:2394:x1875726202679424:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 98us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832230.112241:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 329 00000100:00100000:2.0:1788832230.112247:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 137 00000100:00100000:2.0:1788832230.112253:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2394:x1875726202679680:12345-192.168.203.26@tcp:400:kworker.0 00000100:00080000:1.0:1788832230.112268:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788832230.112273:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788832230.112281:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:352fff76-09db-42cd-818a-16e788a01abb+5:2394:x1875726202679680:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 29us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832230.112288:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 137 00000100:00100000:3.0:1788832230.112853:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832230.113046:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202679936 00000100:00100000:2.0:1788832230.113054:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202679936 00000100:00100000:2.0:1788832230.113119:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 330 00000100:00100000:2.0:1788832230.113128:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2394:x1875726202679936:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832230.113185:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2394:x1875726202679936:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 58us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832230.113192:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 330 00000100:00080000:1.0:1788832230.113340:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788832230.877697:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832231.903738:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832232.150962:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788832232.150996:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218447360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788832232.151109:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832232.151199:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218447360 00000100:00100000:1.0:1788832232.151209:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218447360 00000100:00100000:1.0:1788832232.151490:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788832232.151502:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218447360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788832232.151560:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788832232.152435:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218447360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788832232.153325:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218447360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832232.153351:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000001:00080000:1.0:1788832232.161801:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1788832232.161842:0:6504:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d2b06376180 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788832232.161848:0:6504:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d2c282b0500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d2b06376540 00000020:00080000:1.0:1788832232.161852:0:6504:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9d2c282b0900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d2b08571a00 00000020:00080000:1.0:1788832232.161880:0:6504:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:0.0:1788832232.162101:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537fd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832232.162118:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537fd8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832232.162128:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537fd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832232.162146:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832232.162152:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537fd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832232.162161:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537fd8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832232.162202:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d2c36bdbb00) 00010000:00010000:0.0:1788832232.162206:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832232.162212:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537fd8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832232.162489:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283537fd8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788832232.165529:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00000001:00080000:0.0:1788832232.165559:0:8434:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000020:00080000:3.0:1788832232.166879:0:6557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788832232.166996:0:6557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1788832232.662960:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218447488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788832232.663057:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832232.663442:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218447488 00000100:00100000:1.0:1788832232.663453:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218447488 00000100:00100000:1.0:1788832232.663522:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788832232.663544:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218447488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788832232.663594:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788832232.663931:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218447488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788832232.664436:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218447488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 901us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832232.664446:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00010000:00010000:0.0:1788832232.919064:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832233.175375:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218447616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832233.175478:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832233.176055:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218447872:0@lo:400:kworker.0 00000100:00100000:0.0:1788832233.176103:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832233.176138:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218448384:0@lo:400:kworker.0 00000100:00100000:0.0:1788832233.176163:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832233.176183:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1875726218448896:0@lo:400:kworker.0 00000100:00100000:0.0:1788832233.176218:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832233.176244:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788832233.176250:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218448000:0@lo:400:kworker.0 00000100:00100000:0.0:1788832233.176279:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832233.176296:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218448512:0@lo:400:kworker.0 00000100:00100000:0.0:1788832233.176317:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832233.176483:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218447616 00000100:00100000:3.0:1788832233.176494:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218447616 00000100:00100000:3.0:1788832233.176581:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788832233.176595:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218447616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788832233.176667:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832233.176729:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218447616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832233.176736:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788832233.176796:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218447872 00000100:00100000:3.0:1788832233.176800:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218447872 00000100:00100000:3.0:1788832233.176854:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218448384 00000100:00100000:3.0:1788832233.176859:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218448384 00000100:00100000:3.0:1788832233.176880:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218448896 00000100:00100000:3.0:1788832233.176883:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218448896 00000100:00100000:3.0:1788832233.176898:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218448512 00000100:00100000:3.0:1788832233.176900:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218448512 00000100:00100000:0.0:1788832233.176908:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218449024:0@lo:400:kworker.0 00000100:00100000:3.0:1788832233.176914:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788832233.176921:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218447872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832233.176934:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832233.176955:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218447872:12345-0@lo:400:kworker.0 Request processed in 35us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832233.176957:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218449024 00000100:00100000:0.0:1788832233.176961:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218449024 00000100:00100000:3.0:1788832233.176962:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788832233.176974:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788832233.176979:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218448384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832233.176983:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788832233.176989:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875726218448896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832233.177007:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218448384:12345-0@lo:400:kworker.0 Request processed in 28us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832233.177013:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788832233.177014:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1875726218448896:12345-0@lo:400:kworker.0 Request processed in 26us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832233.177019:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788832233.177023:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788832233.177029:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218448512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832233.177029:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788832233.177034:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875726218449024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832233.177054:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218448512:12345-0@lo:400:kworker.0 Request processed in 26us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832233.177054:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875726218449024:12345-0@lo:400:kworker.0 Request processed in 20us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832233.177061:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788832233.177117:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218447744:0@lo:400:kworker.0 00000100:00100000:1.0:1788832233.177157:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832233.177183:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218448256:0@lo:400:kworker.0 00000100:00100000:1.0:1788832233.177207:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832233.177227:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218448768:0@lo:400:kworker.0 00000100:00100000:1.0:1788832233.177251:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832233.177273:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788832233.177279:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875726218448128:0@lo:400:kworker.0 00000100:00100000:1.0:1788832233.177301:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832233.177314:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218448640:0@lo:400:kworker.0 00000100:00100000:3.0:1788832233.177412:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788832233.177414:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218448128 00000100:00100000:0.0:1788832233.177418:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218448128 00000100:00100000:0.0:1788832233.177440:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788832233.177446:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875726218448128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832233.177526:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788832233.177543:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1788832233.177573:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d2b07e2c700, transno 4294967311 00000100:00100000:2.0:1788832233.177599:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218447616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832233.177819:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218448768 00000100:00100000:2.0:1788832233.177823:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218448768 00000100:00100000:2.0:1788832233.177858:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788832233.177866:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218448768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832233.177915:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218448768:12345-0@lo:400:kworker.0 Request processed in 50us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832233.177916:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218448000 00000100:00100000:3.0:1788832233.177920:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218448000 00000100:00100000:2.0:1788832233.177922:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788832233.177947:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218448256 00000100:00100000:3.0:1788832233.177950:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218448256 00000100:00100000:3.0:1788832233.177963:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788832233.177965:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218447744 00000100:00100000:3.0:1788832233.177968:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218448000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832233.177968:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218447744 00000100:00100000:2.0:1788832233.177992:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1788832233.177998:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3654:x1875726218447744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832233.178008:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218448000:12345-0@lo:400:kworker.0 Request processed in 39us (1728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832233.178023:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788832233.178025:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+24:3654:x1875726218447744:12345-0@lo:400:kworker.0 Request processed in 28us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832233.178031:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788832233.178035:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788832233.178040:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218448256:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788832233.178056:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788832233.178062:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788832233.178064:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788832233.178067:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788832233.178068:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218448256:12345-0@lo:400:kworker.0 Request processed in 28us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832233.178074:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788832233.178296:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875726218448128:12345-0@lo:400:kworker.0 Request processed in 849us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832233.178303:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788832233.178422:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218448000:0@lo:400:kworker.0 00010000:00080000:0.0:1788832233.178442:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b08551180 x1875726218448512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832233.178453:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218448512:0@lo:400:kworker.0 00010000:00080000:0.0:1788832233.178476:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07f11500 x1875726218449024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832233.178485:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218449024:0@lo:400:kworker.0 00000100:00100000:0.0:1788832233.178500:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218447872:0@lo:400:kworker.0 00000100:00100000:0.0:1788832233.178512:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218448384:0@lo:400:kworker.0 00000100:00100000:0.0:1788832233.178525:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1875726218448896:0@lo:400:kworker.0 00000100:00100000:0.0:1788832233.179046:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832233.179088:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218449152:0@lo:400:kworker.0 00000100:00100000:0.0:1788832233.179115:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832233.179154:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218447744:0@lo:400:kworker.0 00000100:00100000:0.0:1788832233.179167:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218448256:0@lo:400:kworker.0 00000100:00100000:0.0:1788832233.179178:0:3654:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:0.0:1788832233.179183:0:3654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d2b0857c380, transno 4294967324 00000004:00080000:0.0:1788832233.179200:0:3654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967326 committed transno 4294967326 00000100:00100000:0.0:1788832233.179219:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218448768:0@lo:400:kworker.0 00000100:00100000:0.0:1788832233.179239:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875726218448128:0@lo:400:kworker.0 00000100:00100000:3.0:1788832233.179644:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218448640 00000100:00100000:3.0:1788832233.179652:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218448640 00000100:00100000:3.0:1788832233.179720:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218449152 00000100:00100000:3.0:1788832233.179724:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218449152 00000100:00100000:3.0:1788832233.179745:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788832233.179753:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218448640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832233.179841:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218448640:12345-0@lo:400:kworker.0 Request processed in 88us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832233.179849:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788832233.179867:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788832233.179873:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218449152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832233.179905:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218449152:12345-0@lo:400:kworker.0 Request processed in 31us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832233.179911:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:1.0:1788832233.180327:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788832233.180333:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788832233.180432:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218448640:0@lo:400:kworker.0 00000100:00100000:3.0:1788832233.180451:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218449152:0@lo:400:kworker.0 00000100:00100000:3.0:1788832233.688572:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218449280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788832233.689328:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832233.690921:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218449280 00000100:00100000:2.0:1788832233.690935:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218449280 00000100:00100000:2.0:1788832233.691009:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788832233.691020:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218449280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788832233.691055:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832233.691346:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218449280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788832233.692431:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218449280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1408us (3099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832233.692441:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00010000:00010000:2.0:1788832233.942831:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832234.198933:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832234.198956:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218449408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832234.199024:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832234.199300:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218449408 00000100:00100000:1.0:1788832234.199308:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218449408 00000100:00100000:1.0:1788832234.199366:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788832234.199385:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218449408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788832234.199415:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788832234.199473:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218449408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832234.199480:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788832234.199788:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218449408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788832234.714752:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788832234.719193:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218449536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788832234.719272:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832234.722287:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218449536 00000100:00100000:0.0:1788832234.722303:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218449536 00000100:00100000:0.0:1788832234.722449:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788832234.722461:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218449536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788832234.722504:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788832234.722589:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218449536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (3317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832234.722597:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788832234.722691:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218449536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788832234.778562:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832234.778650:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202680064 00000100:00100000:3.0:1788832234.778661:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202680064 00000100:00100000:3.0:1788832234.778746:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 255 00000100:00100000:3.0:1788832234.778758:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+18:12161:x1875726202680064:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788832234.778867:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:352fff76-09db-42cd-818a-16e788a01abb+18:12161:x1875726202680064:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 Request processed in 111us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832234.778874:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 255 00000100:00080000:1.0:1788832234.779135:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832234.784377:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832234.784478:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202680192 00000100:00100000:3.0:1788832234.784488:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202680192 00000100:00100000:3.0:1788832234.784580:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 256 00000100:00100000:3.0:1788832234.784591:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:12161:x1875726202680192:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788832234.786838:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+5:12161:x1875726202680192:12345-192.168.203.26@tcp:60:lhsmtool_posix.0 Request processed in 2238us (2460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832234.786853:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 256 00000100:00080000:1.0:1788832234.787611:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788832234.790535:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832234.790803:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202680448 00000100:00100000:1.0:1788832234.790814:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202680448 00000100:00100000:1.0:1788832234.791033:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 65 00000100:00100000:1.0:1788832234.791044:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+18:12161:x1875726202680448:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788832234.791418:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+19:12161:x1875726202680448:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 375us (901us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788832234.791427:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 65 00010000:00010000:2.0:1788832234.967065:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832235.021852:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832235.021965:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202680576 00000100:00100000:2.0:1788832235.021976:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202680576 00000100:00080000:1.0:1788832235.022087:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832235.022132:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 257 00000100:00100000:2.0:1788832235.022143:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:12974:x1875726202680576:12345-192.168.203.26@tcp:101:lsof.0 00010000:00010000:2.0:1788832235.022164:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832235.022185:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229e00/0x998c12b283538064 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04a07 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832235.022257:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b28353806b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832235.022270:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b28353806b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832235.022281:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b28353806b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832235.022342:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788832235.022346:0:13811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788832235.022367:0:13811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b28353806b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832235.022391:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229e00/0x998c12b283538064 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a07 expref: 7 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832235.022409:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b28353806b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a07 expref: 6 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832235.022416:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c36bdbe00) 00010000:00010000:2.0:1788832235.022419:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788832235.022422:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c01228800, rc 0) 00000100:00100000:2.0:1788832235.022480:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:12974:x1875726202680576:12345-192.168.203.26@tcp:101:lsof.0 Request processed in 339us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832235.022487:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 257 00000100:00100000:2.0:1788832235.219670:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832235.219713:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832235.219738:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832235.219776:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832235.219802:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832235.219825:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832235.219852:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202680960 00000100:00100000:2.0:1788832235.219862:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202680960 00000100:00100000:2.0:1788832235.219906:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202680832 00000100:00100000:2.0:1788832235.219910:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202680832 00000100:00100000:2.0:1788832235.219927:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202681344 00000100:00100000:2.0:1788832235.219957:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202681344 00000100:00100000:0.0:1788832235.219999:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 337 00000100:00100000:0.0:1788832235.220018:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202680960:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832235.220047:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202680704 00000100:00100000:1.0:1788832235.220057:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202680704 00000100:00100000:1.0:1788832235.220089:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 391 00000100:00100000:1.0:1788832235.220098:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2396:x1875726202680704:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832235.220109:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202680960:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 99us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832235.220164:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202681216 00000100:00100000:3.0:1788832235.220168:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202681216 00000100:00100000:3.0:1788832235.220198:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202681088 00000100:00100000:3.0:1788832235.220201:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202681088 00000100:00100000:3.0:1788832235.220222:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 141 00000100:00100000:3.0:1788832235.220228:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202681216:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832235.220258:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2396:x1875726202681216:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 30us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832235.220264:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 141 00000100:00100000:3.0:1788832235.220280:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 142 00000100:00100000:3.0:1788832235.220287:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+7:2396:x1875726202681088:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832235.220321:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+7:2396:x1875726202681088:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 35us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832235.220327:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 142 00000100:00100000:1.0:1788832235.220396:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2396:x1875726202680704:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 298us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832235.220403:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 391 00000100:00080000:1.0:1788832235.220583:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788832235.220587:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788832235.220589:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788832235.220902:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 338 00000100:00100000:2.0:1788832235.220915:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+19:2396:x1875726202680832:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832235.220929:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 337 00000100:00100000:0.0:1788832235.220954:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 339 00000100:00100000:2.0:1788832235.220966:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:352fff76-09db-42cd-818a-16e788a01abb+19:2396:x1875726202680832:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 52us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832235.220966:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202681344:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832235.220980:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 338 00000100:00100000:0.0:1788832235.221004:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2396:x1875726202681344:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 42us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832235.221011:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 339 00010000:00010000:0.0:1788832235.992374:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832237.015005:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832237.270937:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788832237.270959:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218449664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788832237.271028:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832237.271319:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218449664 00000100:00100000:2.0:1788832237.271328:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218449664 00000100:00100000:2.0:1788832237.271380:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788832237.271389:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218449664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788832237.271423:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788832237.271480:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218449664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832237.271488:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788832237.271582:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218449664:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788832237.590848:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788832237.590857:0:13800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788832237.590971:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:3.0:1788832237.590980:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1788832237.599247:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:1.0:1788832237.599268:0:6504:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788832237.599351:0:6557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788832237.599366:0:6557:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1788832237.782914:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218449792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788832237.782987:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832237.783714:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218449792 00000100:00100000:2.0:1788832237.783724:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218449792 00000100:00100000:2.0:1788832237.783809:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788832237.783820:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218449792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788832237.783853:0:6530:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788832237.783916:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218449792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832237.783923:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788832237.784000:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218449792:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788832238.039448:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832238.295292:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788832238.295313:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218449920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832238.295390:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832238.295449:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218449920 00000100:00100000:1.0:1788832238.295456:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218449920 00000100:00100000:1.0:1788832238.295519:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788832238.295530:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218449920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788832238.295566:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832238.295612:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218449920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832238.295636:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1788832238.295659:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788832238.295702:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218449920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832238.298049:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218450432:0@lo:400:kworker.0 00000100:00100000:2.0:1788832238.298118:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832238.298169:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218450944:0@lo:400:kworker.0 00000100:00100000:2.0:1788832238.298195:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832238.298210:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218451456:0@lo:400:kworker.0 00000100:00100000:2.0:1788832238.298229:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832238.298265:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788832238.298271:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218450048:0@lo:400:kworker.0 00000100:00100000:2.0:1788832238.298298:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832238.298318:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218450560:0@lo:400:kworker.0 00000100:00100000:2.0:1788832238.298341:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832238.298358:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218451072:0@lo:400:kworker.0 00000100:00100000:0.0:1788832238.298519:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218450304:0@lo:400:kworker.0 00000100:00100000:2.0:1788832238.298548:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832238.298548:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832238.298572:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218450816:0@lo:400:kworker.0 00000100:00100000:2.0:1788832238.298576:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218450176:0@lo:400:kworker.0 00000100:00100000:0.0:1788832238.298592:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832238.298611:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218451328:0@lo:400:kworker.0 00000100:00100000:2.0:1788832238.298644:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218450432 00000100:00100000:2.0:1788832238.298652:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218450432 00000100:00100000:0.0:1788832238.298653:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832238.298681:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218450560 00000100:00100000:0.0:1788832238.298685:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218450560 00000100:00100000:2.0:1788832238.298696:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218450816 00000100:00100000:2.0:1788832238.298699:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218450816 00000100:00100000:0.0:1788832238.298709:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218450304 00000100:00100000:0.0:1788832238.298712:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218450304 00000100:00100000:2.0:1788832238.298719:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218451328 00000100:00100000:2.0:1788832238.298722:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218451328 00000100:00100000:0.0:1788832238.298725:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788832238.298732:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218450560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832238.298736:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788832238.298741:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218450432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832238.298786:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218450432:12345-0@lo:400:kworker.0 Request processed in 43us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832238.298797:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788832238.298818:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788832238.298825:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218450816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832238.298857:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788832238.298866:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218451328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832238.298903:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218451328:12345-0@lo:400:kworker.0 Request processed in 39us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832238.298916:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00080000:1.0:1788832238.298936:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788832238.298939:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1875726218450816:12345-0@lo:400:kworker.0 Request processed in 114us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832238.298949:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788832238.298969:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218450944 00000100:00100000:2.0:1788832238.298973:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218450944 00000100:00100000:2.0:1788832238.299013:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218451456 00000100:00100000:2.0:1788832238.299016:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218451456 00000100:00100000:2.0:1788832238.299035:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218451072 00000100:00100000:2.0:1788832238.299038:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218451072 00000100:00100000:2.0:1788832238.299049:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788832238.299055:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218450944:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788832238.299115:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788832238.299118:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832238.300514:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832238.300557:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218450688:0@lo:400:kworker.0 00000100:00100000:1.0:1788832238.300598:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832238.300635:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218451200:0@lo:400:kworker.0 00000100:00100000:1.0:1788832238.300657:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832238.300692:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218450176 00000100:00100000:1.0:1788832238.300698:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218450176 00000100:00100000:1.0:1788832238.300731:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218450688 00000100:00100000:1.0:1788832238.300734:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218450688 00000100:00100000:1.0:1788832238.300753:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218451200 00000100:00100000:1.0:1788832238.300756:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218451200 00000100:00100000:1.0:1788832238.300770:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788832238.300777:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218450176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832238.300818:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218450176:12345-0@lo:400:kworker.0 Request processed in 42us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832238.300825:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788832238.300840:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788832238.300845:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218450688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832238.300869:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218450688:12345-0@lo:400:kworker.0 Request processed in 24us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832238.300874:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788832238.300885:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788832238.300891:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218451200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832238.300928:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218451200:12345-0@lo:400:kworker.0 Request processed in 37us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832238.300934:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00080000:1.0:1788832238.300950:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832238.300987:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218450176:0@lo:400:kworker.0 00000100:00100000:1.0:1788832238.300996:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218450688:0@lo:400:kworker.0 00000100:00100000:1.0:1788832238.301003:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218451200:0@lo:400:kworker.0 00000100:00100000:0.0:1788832238.301778:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218450560:12345-0@lo:400:kworker.0 Request processed in 3041us (3432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832238.301788:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788832238.301812:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788832238.301822:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218450304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832238.301866:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218450304:12345-0@lo:400:kworker.0 Request processed in 48us (3318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832238.301873:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788832238.301911:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218450304:0@lo:400:kworker.0 00010000:00080000:0.0:1788832238.301928:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b08550000 x1875726218450816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832238.301940:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218450816:0@lo:400:kworker.0 00010000:00080000:0.0:1788832238.301956:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b08574380 x1875726218451328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832238.301965:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218451328:0@lo:400:kworker.0 00000100:00100000:3.0:1788832238.303355:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788832238.303373:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218451456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832238.303534:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218451456:12345-0@lo:400:kworker.0 Request processed in 169us (5303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832238.303541:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788832238.303565:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788832238.303573:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218451072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832238.303603:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218451072:12345-0@lo:400:kworker.0 Request processed in 31us (5055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832238.303609:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788832238.303761:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218450048 00000100:00100000:3.0:1788832238.303768:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218450048 00000100:00100000:3.0:1788832238.303839:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788832238.303846:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218450048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832238.303888:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218450048:12345-0@lo:400:kworker.0 Request processed in 43us (5589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832238.303894:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1788832238.307168:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218450944:12345-0@lo:400:kworker.0 Request processed in 8103us (8962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832238.307184:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788832238.309524:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218450048:0@lo:400:kworker.0 00000100:00100000:0.0:1788832238.309547:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218450560:0@lo:400:kworker.0 00000100:00100000:0.0:1788832238.309561:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218451072:0@lo:400:kworker.0 00000100:00100000:0.0:1788832238.309575:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218450432:0@lo:400:kworker.0 00000100:00100000:0.0:1788832238.309586:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218450944:0@lo:400:kworker.0 00000100:00100000:0.0:1788832238.309597:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218451456:0@lo:400:kworker.0 00000040:00080000:0.0:1788832238.488561:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1788832238.583443:0:15066:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 21:50:37 (1788832237) 00000100:00100000:0.0:1788832238.807269:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788832238.807292:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218451584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788832238.807362:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832238.807477:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218451584 00000100:00100000:1.0:1788832238.807485:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218451584 00000100:00100000:1.0:1788832238.807559:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788832238.807570:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218451584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788832238.807595:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832238.807671:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218451584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832238.807678:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788832238.807806:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218451584:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788832239.066670:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832239.320913:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218451712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832239.320986:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832239.323807:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218451712 00000100:00100000:0.0:1788832239.323825:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218451712 00000100:00100000:0.0:1788832239.323900:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788832239.323911:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218451712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788832239.323946:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788832239.324515:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218451712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 604us (3526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832239.324523:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788832239.324752:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218451712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788832239.831327:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788832239.831351:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218451840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788832239.831413:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832239.831469:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218451840 00000100:00100000:3.0:1788832239.831477:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218451840 00000100:00100000:3.0:1788832239.831534:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788832239.831543:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218451840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788832239.831565:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788832239.831640:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218451840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832239.831647:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788832239.831694:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218451840:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788832240.087184:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832240.346578:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832240.346617:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832240.346659:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832240.346673:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832240.346687:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832240.346709:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832240.346728:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832240.346751:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202681984 00000100:00100000:0.0:1788832240.346760:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202681984 00000100:00100000:0.0:1788832240.346813:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202681856 00000100:00100000:0.0:1788832240.346816:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202681856 00000100:00100000:0.0:1788832240.346834:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 146 00000100:00100000:0.0:1788832240.346843:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+5:2394:x1875726202681984:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832240.346900:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+5:2394:x1875726202681984:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 58us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832240.346907:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 146 00000100:00100000:0.0:1788832240.346921:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 147 00000100:00100000:0.0:1788832240.346926:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+7:2394:x1875726202681856:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832240.346944:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:352fff76-09db-42cd-818a-16e788a01abb+7:2394:x1875726202681856:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 19us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832240.346950:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 147 00000100:00100000:3.0:1788832240.347065:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202681728 00000100:00100000:3.0:1788832240.347069:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202681728 00000100:00100000:3.0:1788832240.347100:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202682240 00000100:00100000:3.0:1788832240.347103:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202682240 00000100:00100000:3.0:1788832240.347113:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202681600 00000100:00100000:3.0:1788832240.347115:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202681600 00000100:00100000:3.0:1788832240.347124:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202682112 00000100:00100000:3.0:1788832240.347126:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202682112 00000100:00100000:3.0:1788832240.347138:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 346 00000100:00100000:3.0:1788832240.347149:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2394:x1875726202681728:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832240.347175:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2394:x1875726202681728:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832240.347181:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 346 00000100:00100000:3.0:1788832240.347191:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 347 00000100:00100000:3.0:1788832240.347196:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2394:x1875726202682240:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832240.347213:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2394:x1875726202682240:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 17us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832240.347218:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 347 00000100:00100000:3.0:1788832240.347226:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 348 00000100:00100000:3.0:1788832240.347231:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+18:2394:x1875726202681600:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832240.347247:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+18:2394:x1875726202681600:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 16us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832240.347252:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 348 00000100:00100000:3.0:1788832240.347260:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 349 00000100:00100000:1.0:1788832240.349386:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202681472 00000100:00100000:1.0:1788832240.349400:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202681472 00000100:00100000:1.0:1788832240.349460:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 393 00000100:00100000:1.0:1788832240.349470:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2394:x1875726202681472:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832240.349546:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2394:x1875726202681472:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 76us (2977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832240.349555:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 393 00000100:00080000:1.0:1788832240.349597:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788832240.349603:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788832240.349606:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788832240.349639:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788832240.350025:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:2394:x1875726202682112:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832240.350065:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:2394:x1875726202682112:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 2800us (3336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832240.350073:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 349 00010000:00010000:2.0:1788832241.111385:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832242.135106:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832242.391243:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218451968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788832242.391325:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832242.392022:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218451968 00000100:00100000:0.0:1788832242.392031:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218451968 00000100:00100000:0.0:1788832242.392182:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788832242.392193:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218451968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788832242.392227:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788832242.392293:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218451968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832242.392300:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788832242.392390:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218451968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788832242.902992:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832242.903027:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07e2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218452096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788832242.903106:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832242.903262:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218452096 00000100:00100000:0.0:1788832242.903276:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218452096 00000100:00100000:0.0:1788832242.903332:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788832242.903341:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218452096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788832242.903375:0:7934:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788832242.903441:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218452096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832242.903447:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788832242.903696:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07e2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218452096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788832243.012755:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832243.012863:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202682496 00000100:00100000:1.0:1788832243.012876:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202682496 00000100:00100000:1.0:1788832243.012974:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:1.0:1788832243.012987:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+18:13198:x1875726202682496:12345-192.168.203.26@tcp:35:umount.0 00000100:00100000:1.0:1788832243.013548:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+19:13198:x1875726202682496:12345-192.168.203.26@tcp:35:umount.0 Request processed in 561us (804us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788832243.013558:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00080000:2.0:1788832243.015111:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832243.019883:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832243.020898:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202682752 00000100:00100000:3.0:1788832243.020915:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202682752 00000100:00100000:3.0:1788832243.021015:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:3.0:1788832243.021026:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+19:13198:x1875726202682752:12345-192.168.203.26@tcp:35:umount.0 00000100:00100000:3.0:1788832243.021901:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:352fff76-09db-42cd-818a-16e788a01abb+20:13198:x1875726202682752:12345-192.168.203.26@tcp:35:umount.0 Request processed in 868us (2035us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788832243.021915:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:0.0:1788832243.027326:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832243.027664:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202683008 00000100:00100000:1.0:1788832243.027679:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202683008 00000100:00100000:1.0:1788832243.027759:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:1.0:1788832243.027772:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c099bf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+20:13198:x1875726202683008:12345-192.168.203.26@tcp:35:umount.0 00000100:00100000:1.0:1788832243.028097:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c099bf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+21:13198:x1875726202683008:12345-192.168.203.26@tcp:35:umount.0 Request processed in 325us (785us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788832243.028106:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:0.0:1788832243.040410:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832243.040510:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202683264 00000100:00100000:1.0:1788832243.040523:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202683264 00000100:00100000:1.0:1788832243.040596:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:1.0:1788832243.040610:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+21:13198:x1875726202683264:12345-192.168.203.26@tcp:35:umount.0 00000100:00100000:1.0:1788832243.041049:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:352fff76-09db-42cd-818a-16e788a01abb+22:13198:x1875726202683264:12345-192.168.203.26@tcp:35:umount.0 Request processed in 441us (653us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1788832243.041059:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:2.0:1788832243.051594:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832243.051695:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832243.051740:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832243.051845:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202683392 00000100:00100000:1.0:1788832243.051859:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202683392 00000100:00100000:1.0:1788832243.051940:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202683648 00000100:00100000:1.0:1788832243.051961:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202683648 00000100:00100000:1.0:1788832243.051995:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202683520 00000100:00100000:1.0:1788832243.051998:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202683520 00000100:00100000:1.0:1788832243.052021:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:1.0:1788832243.052032:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08576a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:229a6744-cc0e-4765-812a-1d39bc7df2da+15:2393:x1875726202683392:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832243.052051:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832243.052087:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c36db8800/0x998c12b283537042 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0455a expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832243.052108:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832243.052363:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08576a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:229a6744-cc0e-4765-812a-1d39bc7df2da+14:2393:x1875726202683392:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 330us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832243.052373:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:1.0:1788832243.052398:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:1.0:1788832243.052404:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:229a6744-cc0e-4765-812a-1d39bc7df2da+13:2393:x1875726202683648:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832243.052412:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832243.052422:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c421d2c00/0x998c12b28353725d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04633 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832243.052433:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832243.052452:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08575f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:229a6744-cc0e-4765-812a-1d39bc7df2da+12:2393:x1875726202683648:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 49us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832243.052458:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:1.0:1788832243.052481:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:1.0:1788832243.052489:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08577b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:229a6744-cc0e-4765-812a-1d39bc7df2da+11:2393:x1875726202683520:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832243.052496:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832243.052505:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c092dce00/0x998c12b283536f85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0451b expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832243.052524:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832243.052543:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08577b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:229a6744-cc0e-4765-812a-1d39bc7df2da+10:2393:x1875726202683520:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 55us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832243.052550:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:2.0:1788832243.055407:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832243.055953:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202683776 00000100:00100000:3.0:1788832243.055977:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202683776 00000100:00100000:3.0:1788832243.056083:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 81 00000100:00100000:3.0:1788832243.056096:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2392:x1875726202683776:12345-192.168.203.26@tcp:9:umount.0 00000020:00000080:3.0:1788832243.056140:0:8442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283537360 00000100:00080000:3.0:1788832243.056153:0:8442:0:(import.c:65:import_set_state_nolock()) ffff9d2c3fc30000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788832243.056229:0:8442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788832243.056449:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:352fff76-09db-42cd-818a-16e788a01abb+2:2392:x1875726202683776:12345-192.168.203.26@tcp:9:umount.0 Request processed in 355us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832243.056459:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 81 00010000:00010000:1.0:1788832243.056788:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788832243.057525:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788832243.064883:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832243.065058:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202684160 00000100:00100000:2.0:1788832243.065078:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202684160 00000100:00100000:2.0:1788832243.065186:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 82 00000100:00100000:2.0:1788832243.065200:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:352fff76-09db-42cd-818a-16e788a01abb+7:2392:x1875726202684160:12345-192.168.203.26@tcp:9:umount.0 00000020:00000080:2.0:1788832243.065279:0:10099:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b2835375d6 00000020:00010000:2.0:1788832243.065289:0:10099:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9d2c050ce800: total 0 00000100:00080000:2.0:1788832243.065295:0:10099:0:(import.c:65:import_set_state_nolock()) ffff9d2c050c9000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788832243.065361:0:10099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:2.0:1788832243.065581:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:352fff76-09db-42cd-818a-16e788a01abb+5:2392:x1875726202684160:12345-192.168.203.26@tcp:9:umount.0 Request processed in 382us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832243.065589:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 82 00000100:00080000:1.0:1788832243.065986:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:3.0:1788832243.066062:0:6513:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9d2c050ce800: total 0 00010000:00010000:3.0:1788832243.066116:0:6513:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d2c050ce800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788832243.066203:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eef0ec67/0x998c12b28353805d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a00 expref: 4 pid: 10099 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832243.066259:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098ff7157/0x998c12b28353798e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0481d expref: 3 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832243.066290:0:6513:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d2c050ce800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788832243.066302:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832243.066304:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832243.066306:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832243.082506:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832243.082678:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202685184 00000100:00100000:1.0:1788832243.082692:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202685184 00000100:00100000:1.0:1788832243.082782:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 258 00000100:00100000:1.0:1788832243.082795:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+22:2392:x1875726202685184:12345-192.168.203.26@tcp:39:umount.0 00000020:00000080:1.0:1788832243.082845:0:6525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536f93 00000020:00010000:1.0:1788832243.082868:0:6525:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9d2b057da800: total 0 00000100:00080000:1.0:1788832243.082874:0:6525:0:(import.c:65:import_set_state_nolock()) ffff9d2b057da000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788832243.082916:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1788832243.083152:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:352fff76-09db-42cd-818a-16e788a01abb+21:2392:x1875726202685184:12345-192.168.203.26@tcp:39:umount.0 Request processed in 358us (659us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1788832243.083161:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 258 00000020:00010000:0.0:1788832243.083343:0:6514:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9d2b057da800: total 0 00010000:00010000:0.0:1788832243.083411:0:6514:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d2b057da800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788832243.083457:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:0.0:1788832243.083462:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788832243.083479:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031c00/0x998c12b283537d00 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04919 expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832243.083505:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c36bdbe00) 00010000:00010000:0.0:1788832243.083507:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788832243.083511:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835379f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04839 expref: 19 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832243.083525:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:0.0:1788832243.083527:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788832243.083530:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283538048 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049f9 expref: 18 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832243.083568:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:0.0:1788832243.083570:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788832243.083574:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffc00/0x998c12b283537336 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0465d expref: 17 pid: 8742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832243.083586:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:0.0:1788832243.083588:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788832243.083592:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c390f2400/0x998c12b283537f3e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049b3 expref: 16 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832243.083604:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:0.0:1788832243.083607:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788832243.083610:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dda00/0x998c12b283537979 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04816 expref: 15 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832243.083694:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d2c0f9a5200) 00010000:00010000:0.0:1788832243.083697:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788832243.083701:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd200/0x998c12b283537631 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04736 expref: 14 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832243.083722:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d2b073ae800) 00010000:00010000:0.0:1788832243.083724:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832243.083727:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfea00/0x998c12b2835372db lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04648 expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832243.083741:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:0.0:1788832243.083743:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788832243.083753:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc200/0x998c12b28353794f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04808 expref: 12 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832243.083770:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d2c03837700) 00010000:00010000:0.0:1788832243.083773:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788832243.083776:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2000/0x998c12b2835372bf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04641 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832243.083791:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d2c100ce000) 00010000:00010000:0.0:1788832243.083793:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788832243.083797:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0ca00/0x998c12b283537a13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04840 expref: 10 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832243.083814:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d2b073ad800) 00010000:00010000:0.0:1788832243.083817:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788832243.083821:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228a00/0x998c12b28353801e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc049eb expref: 9 pid: 6527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832243.083835:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d2b073ae600) 00010000:00010000:0.0:1788832243.083837:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788832243.083841:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d000/0x998c12b28353786f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc047d0 expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832243.083853:0:6514:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d2b057da800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788832243.083872:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832243.083874:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832243.083876:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832243.094766:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832243.094837:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202685312 00000100:00100000:3.0:1788832243.094854:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202685312 00000100:00100000:3.0:1788832243.095001:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 259 00000100:00100000:3.0:1788832243.095014:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+5:2392:x1875726202685312:12345-192.168.203.26@tcp:39:umount.0 00000020:00000080:3.0:1788832243.095058:0:6527:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536f9a 00000100:00080000:3.0:1788832243.095088:0:6527:0:(import.c:65:import_set_state_nolock()) ffff9d2c3fc33000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788832243.095125:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788832243.095416:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:352fff76-09db-42cd-818a-16e788a01abb+3:2392:x1875726202685312:12345-192.168.203.26@tcp:39:umount.0 Request processed in 403us (663us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788832243.095426:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 259 00010000:00010000:2.0:1788832243.095881:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788832243.096328:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788832243.159511:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832243.415097:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875726218452352:0@lo:400:kworker.0 00000100:00100000:3.0:1788832243.415102:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218452224:0@lo:400:kworker.0 00000100:00100000:2.0:1788832243.415195:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218452608:0@lo:400:kworker.0 00000100:00100000:0.0:1788832243.415403:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218452480:0@lo:400:kworker.0 00000100:00100000:3.0:1788832243.415577:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832243.415674:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218452736:0@lo:400:kworker.0 00000100:00100000:3.0:1788832243.415704:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832243.415726:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218453248:0@lo:400:kworker.0 00000100:00100000:3.0:1788832243.415752:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832243.415781:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218453760:0@lo:400:kworker.0 00000100:00100000:3.0:1788832243.415805:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832243.416309:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788832243.416319:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218453376:0@lo:400:kworker.0 00000100:00100000:3.0:1788832243.416358:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832243.416382:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218453888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832243.416406:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832243.416449:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218452224 00000100:00100000:3.0:1788832243.416459:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218452224 00000100:00100000:3.0:1788832243.416533:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1788832243.416543:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3653:x1875726218452224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832243.416616:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e55f0905-9d39-4464-9830-326b420fb582+24:3653:x1875726218452224:12345-0@lo:400:kworker.0 Request processed in 74us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832243.416649:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1788832243.416691:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218453248 00000100:00100000:3.0:1788832243.416696:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218453248 00000100:00100000:3.0:1788832243.416737:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218453760 00000100:00100000:3.0:1788832243.416741:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218453760 00000100:00100000:3.0:1788832243.416771:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788832243.416778:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218453248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832243.416814:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218453248:12345-0@lo:400:kworker.0 Request processed in 37us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832243.416821:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788832243.417138:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788832243.417147:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218453760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832243.417197:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218453760:12345-0@lo:400:kworker.0 Request processed in 52us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832243.417204:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788832243.417231:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218453376 00000100:00100000:3.0:1788832243.417248:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218453376 00000100:00100000:3.0:1788832243.417285:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788832243.417292:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218453376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832243.417328:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218453376:12345-0@lo:400:kworker.0 Request processed in 37us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832243.417335:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788832243.417356:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218453888 00000100:00100000:3.0:1788832243.417360:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218453888 00000100:00100000:3.0:1788832243.417401:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788832243.417409:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218453888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788832243.417435:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832243.417479:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218453888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832243.417486:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:3.0:1788832243.417513:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788832243.417518:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788832243.417520:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788832243.417534:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218452736 00000100:00100000:3.0:1788832243.417538:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218452736 00000100:00100000:3.0:1788832243.417569:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788832243.417577:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218452736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832243.417616:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218452736:12345-0@lo:400:kworker.0 Request processed in 40us (1911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832243.417644:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788832243.417691:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218453376:0@lo:400:kworker.0 00000100:00100000:3.0:1788832243.417711:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218453888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788832243.417720:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218453760:0@lo:400:kworker.0 00000100:00100000:3.0:1788832243.417743:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218452224:0@lo:400:kworker.0 00000100:00100000:3.0:1788832243.417756:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218452736:0@lo:400:kworker.0 00000100:00100000:3.0:1788832243.417769:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218453248:0@lo:400:kworker.0 00000100:00100000:1.0:1788832243.424733:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832243.424808:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218452864:0@lo:400:kworker.0 00000100:00100000:1.0:1788832243.424859:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832243.424917:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218452352 00000100:00100000:1.0:1788832243.424927:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218452352 00000100:00100000:1.0:1788832243.425861:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218452864 00000100:00100000:1.0:1788832243.425869:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218452864 00000100:00100000:3.0:1788832243.426525:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788832243.426545:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875726218452352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832243.426634:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832243.426654:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875726218452352:12345-0@lo:400:kworker.0 Request processed in 115us (1932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832243.426664:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788832243.426681:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218453120:0@lo:400:kworker.0 00000100:00100000:3.0:1788832243.426691:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218452608 00000100:00100000:3.0:1788832243.426697:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218452608 00000100:00100000:2.0:1788832243.426720:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832243.426730:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788832243.426739:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218452864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832243.426769:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1875726218452864:12345-0@lo:400:kworker.0 Request processed in 33us (1909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832243.426773:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788832243.426782:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788832243.426788:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218452608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832243.426813:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218452608:12345-0@lo:400:kworker.0 Request processed in 26us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832243.426819:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788832243.426931:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218453120 00000100:00100000:3.0:1788832243.426934:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218453120 00000100:00100000:3.0:1788832243.426958:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788832243.426962:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218453120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832243.427007:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218453120:12345-0@lo:400:kworker.0 Request processed in 43us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832243.427013:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788832243.427027:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218453632:0@lo:400:kworker.0 00000100:00100000:2.0:1788832243.427061:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832243.427108:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218452608:0@lo:400:kworker.0 00000100:00100000:2.0:1788832243.427122:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218453120:0@lo:400:kworker.0 00000100:00100000:2.0:1788832243.427159:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218453632 00000100:00100000:2.0:1788832243.427163:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218453632 00000100:00080000:3.0:1788832243.427190:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788832243.427197:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832243.427201:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1788832243.427202:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832243.427214:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218453632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832243.432555:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218453632:12345-0@lo:400:kworker.0 Request processed in 5328us (5478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832243.432573:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788832243.435726:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218453632:0@lo:400:kworker.0 00000100:00100000:0.0:1788832243.440549:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832243.440662:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218452992:0@lo:400:kworker.0 00000100:00100000:2.0:1788832243.440690:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218452480 00000100:00100000:2.0:1788832243.440711:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218452480 00000100:00100000:0.0:1788832243.440781:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832243.440799:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788832243.440812:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218452480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832243.440822:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218452992 00000100:00100000:0.0:1788832243.440827:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218452992 00000100:00100000:0.0:1788832243.440878:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788832243.440888:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218452992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832243.440897:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218452480:12345-0@lo:400:kworker.0 Request processed in 86us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832243.440906:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788832243.440935:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218452992:12345-0@lo:400:kworker.0 Request processed in 48us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832243.440943:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00080000:0.0:1788832243.440968:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788832243.441003:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fd0d500 x1875726218452992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832243.441022:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218452992:0@lo:400:kworker.0 00000100:00100000:0.0:1788832243.441031:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218453504:0@lo:400:kworker.0 00000100:00100000:0.0:1788832243.441055:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832243.441124:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218452480:0@lo:400:kworker.0 00000100:00100000:2.0:1788832243.441201:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218453504 00000100:00100000:2.0:1788832243.441207:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218453504 00000100:00100000:2.0:1788832243.441254:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788832243.441261:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875726218453504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832243.441299:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1875726218453504:12345-0@lo:400:kworker.0 Request processed in 37us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832243.441305:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788832243.442231:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218452864:0@lo:400:kworker.0 00000100:00100000:1.0:1788832243.442292:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875726218452352:0@lo:400:kworker.0 00000100:00080000:0.0:1788832243.442361:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788832243.442392:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc07800 x1875726218453504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832243.442404:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218453504:0@lo:400:kworker.0 00000100:00100000:2.0:1788832243.927258:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218454016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788832243.927362:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832243.927538:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218454016 00000100:00100000:3.0:1788832243.927549:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218454016 00000100:00100000:3.0:1788832243.927618:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788832243.927653:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218454016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788832243.927686:0:8444:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832243.927767:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218454016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832243.927775:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788832243.929051:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218454016:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788832244.183952:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832244.439405:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832244.439438:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0857d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218454144:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832244.439547:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832244.439704:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218454144 00000100:00100000:1.0:1788832244.439715:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218454144 00000100:00100000:1.0:1788832244.439790:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788832244.439802:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218454144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788832244.439841:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788832244.439903:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218454144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832244.439911:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788832244.440167:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0857d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218454144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788832244.953288:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832244.953333:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218454272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788832244.953473:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832244.953833:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218454272 00000100:00100000:3.0:1788832244.953844:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218454272 00000100:00100000:3.0:1788832244.953927:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788832244.953940:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218454272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788832244.953986:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788832244.954074:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218454272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832244.954083:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788832244.954252:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218454272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788832245.143731:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832245.143786:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832245.143830:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202685696 00000100:00100000:1.0:1788832245.143846:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202685696 00000100:00100000:3.0:1788832245.143882:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832245.147008:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832245.147754:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202685952 00000100:00100000:3.0:1788832245.147770:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202685952 00000100:00100000:3.0:1788832245.147870:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 260 00000100:00100000:3.0:1788832245.147885:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5983f70-61a6-4df8-ba8a-04bd100176c7+6:2392:x1875726202685952:12345-192.168.203.26@tcp:39:umount.0 00000020:00000080:3.0:1788832245.147940:0:13811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b2835370b2 00000020:00010000:3.0:1788832245.147951:0:13811:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9d2b076ea800: total 0 00000100:00080000:3.0:1788832245.147957:0:13811:0:(import.c:65:import_set_state_nolock()) ffff9d2b076ee800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788832245.147995:0:13811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:3.0:1788832245.148785:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2392:x1875726202685952:12345-192.168.203.26@tcp:39:umount.0 Request processed in 899us (1786us total) trans 4294967529 rc 0/0 00000100:00100000:3.0:1788832245.148796:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 260 00000020:00010000:3.0:1788832245.149034:0:13191:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9d2b076ea800: total 0 00010000:00010000:3.0:1788832245.149039:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832245.149112:0:13191:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d2b076ea800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788832245.149173:0:13191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c36bdbe00) 00010000:00010000:3.0:1788832245.149178:0:13191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788832245.149189:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b28353806b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a07 expref: 4 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832245.149213:0:13191:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d2b076ea800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788832245.149225:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832245.149228:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832245.149229:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788832245.149251:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832245.149814:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202685440 00000100:00100000:1.0:1788832245.149825:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202685440 00000100:00100000:1.0:1788832245.149881:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202685568 00000100:00100000:1.0:1788832245.149885:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202685568 00000100:00100000:1.0:1788832245.149916:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:1.0:1788832245.149928:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:229a6744-cc0e-4765-812a-1d39bc7df2da+12:2394:x1875726202685696:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832245.149945:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832245.149962:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c1fe0de00/0x998c12b283537256 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0462c expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832245.149979:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832245.150143:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:2.0:1788832245.150160:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:2.0:1788832245.150170:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:229a6744-cc0e-4765-812a-1d39bc7df2da+11:2396:x1875726202685568:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832245.150179:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832245.150207:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c390f3600/0x998c12b28353709d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc045a0 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832245.150220:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832245.150283:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:229a6744-cc0e-4765-812a-1d39bc7df2da+10:2396:x1875726202685568:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 116us (6401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832245.150291:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:2.0:1788832245.150329:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c0947bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:229a6744-cc0e-4765-812a-1d39bc7df2da+9:2396:x1875726202685440:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832245.150338:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832245.150348:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c36db9c00/0x998c12b283537096 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc0456f expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832245.150358:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832245.150539:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c0947bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:229a6744-cc0e-4765-812a-1d39bc7df2da+8:2396:x1875726202685440:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 387us (6752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832245.150547:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:1.0:1788832245.156505:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:229a6744-cc0e-4765-812a-1d39bc7df2da+7:2394:x1875726202685696:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 6562us (12771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832245.156541:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:3.0:1788832245.158006:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832245.159568:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202686080 00000100:00100000:2.0:1788832245.159590:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202686080 00000100:00100000:2.0:1788832245.159796:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 261 00000100:00100000:2.0:1788832245.159811:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+5:2392:x1875726202686080:12345-192.168.203.26@tcp:39:umount.0 00000020:00000080:2.0:1788832245.159877:0:8742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b2835370ab 00000100:00080000:2.0:1788832245.159891:0:8742:0:(import.c:65:import_set_state_nolock()) ffff9d2c36d27800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788832245.159924:0:8742:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:3.0:1788832245.160268:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788832245.160306:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832245.160494:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c5983f70-61a6-4df8-ba8a-04bd100176c7+3:2392:x1875726202686080:12345-192.168.203.26@tcp:39:umount.0 Request processed in 685us (2496us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788832245.160503:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 261 00000100:00100000:3.0:1788832245.189570:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832245.189811:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202686336 00000100:00100000:1.0:1788832245.189827:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202686336 00000100:00100000:1.0:1788832245.189914:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 395 00000100:00100000:1.0:1788832245.189927:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+7:2392:x1875726202686336:12345-192.168.203.26@tcp:251:umount.0 00000020:00000080:1.0:1788832245.189992:0:6518:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536f70 00000020:00010000:1.0:1788832245.190003:0:6518:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9d2c3e9ed000: total 0 00000100:00080000:1.0:1788832245.190009:0:6518:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e71c800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788832245.190123:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:229a6744-cc0e-4765-812a-1d39bc7df2da+3:2392:x1875726202686336:12345-192.168.203.26@tcp:251:umount.0 Request processed in 198us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832245.190132:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 395 00000020:00010000:0.0:1788832245.190811:0:6514:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9d2c3e9ed000: total 0 00010000:00010000:0.0:1788832245.190888:0:6514:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d2c3e9ed000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788832245.190935:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c36db8000/0x998c12b283537049 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04561 expref: 2 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832245.191009:0:6514:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d2c3e9ed000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788832245.191022:0:6514:0:(genops.c:885:class_export_put()) final put ffff9d2c3e9ed000/229a6744-cc0e-4765-812a-1d39bc7df2da 00010000:00010000:0.0:1788832245.191048:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832245.191058:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832245.191060:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788832245.191115:0:14992:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3e9ed000/229a6744-cc0e-4765-812a-1d39bc7df2da for MGS 00000020:00000080:2.0:1788832245.191171:0:14992:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c3e71c800 for MGS 00010000:00010000:3.0:1788832245.207962:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832246.233431:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788832246.857026:0:15261:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788832246.864761:0:15261:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788832246.864817:0:15261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3400/0x998c12b283537018 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353701f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832246.864832:0:15261:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3400/0x998c12b283537018 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b28353701f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832246.864839:0:15261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3400/0x998c12b283537018 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b28353701f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832246.864846:0:15261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3400/0x998c12b283537018 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b28353701f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832246.864877:0:15261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788832246.864882:0:15261:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788832246.864908:0:15261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788832246.864912:0:15261:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788832246.864918:0:15261:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788832246.864941:0:15261:0:(import.c:65:import_set_state_nolock()) ffff9d2c1fe5a000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788832246.865188:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832246.865197:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3400/0x998c12b283537018 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b28353701f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.865214:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c390f3400 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832246.865219:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3400/0x998c12b283537018 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b28353701f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.865227:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3400/0x998c12b283537018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x998c12b28353701f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832246.865234:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3400/0x998c12b283537018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x998c12b28353701f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832246.865239:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788832246.865242:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788832246.865244:0:6514:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788832246.865274:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3400/0x998c12b283537018 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b28353701f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.865280:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832246.865310:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3400/0x998c12b283537018 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b28353701f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.865317:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3400/0x998c12b283537018 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b28353701f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.865328:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832246.865330:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832246.865331:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832246.865346:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875726218454400:0@lo:39:umount.0 00000100:00100000:2.0:1788832246.865381:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218454528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788832246.865419:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832246.865419:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832246.865497:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218454400 00000100:00100000:2.0:1788832246.865497:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218454528 00000100:00100000:3.0:1788832246.865503:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218454400 00000100:00100000:2.0:1788832246.865503:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218454528 00000100:00100000:2.0:1788832246.865554:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788832246.865564:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e55f0905-9d39-4464-9830-326b420fb582+24:3654:x1875726218454528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788832246.865575:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832246.865590:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c092dd800/0x998c12b28353701f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x998c12b283537018 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832246.865608:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832246.865679:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e55f0905-9d39-4464-9830-326b420fb582+23:3654:x1875726218454528:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832246.865686:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788832246.865729:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:3654:1875726218454528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832246.865770:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788832246.865779:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875726218454400:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788832246.865802:0:13811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536b87 00000100:00080000:2.0:1788832246.865810:0:13811:0:(import.c:65:import_set_state_nolock()) ffff9d2c08e7f800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788832246.865832:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832246.865861:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3650:x1875726218454400:12345-0@lo:39:umount.0 Request processed in 84us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832246.865869:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00080000:3.0:1788832246.865872:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c1fe5a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:2.0:1788832246.865876:0:13811:0:(genops.c:885:class_export_put()) final put ffff9d2c08e7c000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1788832246.865881:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875726218454400:0@lo:39:umount.0 00000100:00080000:3.0:1788832246.865907:0:15261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000020:00000080:1.0:1788832246.865907:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c08e7c000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1788832246.865914:0:15261:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788832246.865919:0:15261:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788832246.865961:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c08e7f800 for lustre-MDT0000 00010000:00010000:3.0:1788832246.868473:0:15261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3a00/0x998c12b283537026 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353702d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.868490:0:15261:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3a00/0x998c12b283537026 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b28353702d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.868497:0:15261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3a00/0x998c12b283537026 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b28353702d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.868504:0:15261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3a00/0x998c12b283537026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b28353702d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.868536:0:15261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788832246.868700:0:15261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9400/0x998c12b283536f2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536f31 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832246.868705:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832246.868708:0:15261:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9400/0x998c12b283536f2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536f31 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832246.868712:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3a00/0x998c12b283537026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b28353702d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.868715:0:15261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9400/0x998c12b283536f2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283536f31 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832246.868720:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d3a00 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832246.868724:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3a00/0x998c12b283537026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b28353702d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832246.868733:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3a00/0x998c12b283537026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x998c12b28353702d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.868734:0:15261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9400/0x998c12b283536f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283536f31 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832246.868741:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3a00/0x998c12b283537026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x998c12b28353702d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.868747:0:15261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788832246.868756:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788832246.868757:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1788832246.868758:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788832246.868761:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9400/0x998c12b283536f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283536f31 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.868766:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c36db9400 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832246.868768:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9400/0x998c12b283536f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283536f31 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.868774:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9400/0x998c12b283536f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x998c12b283536f31 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832246.868779:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9400/0x998c12b283536f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x998c12b283536f31 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832246.868783:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788832246.868785:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788832246.868787:0:6514:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788832246.868787:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3a00/0x998c12b283537026 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b28353702d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832246.868792:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832246.868800:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9400/0x998c12b283536f2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283536f31 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.868806:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832246.868813:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9400/0x998c12b283536f2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283536f31 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832246.868813:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3a00/0x998c12b283537026 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b28353702d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.868821:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9400/0x998c12b283536f2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283536f31 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832246.868821:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3a00/0x998c12b283537026 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b28353702d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832246.868832:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832246.868833:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832246.868834:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832246.868834:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832246.868836:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832246.868836:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832246.868847:0:15261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b28353728e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537295 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832246.868852:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218454656:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788832246.868853:0:15261:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b28353728e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283537295 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.868859:0:15261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b28353728e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283537295 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.868865:0:15261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b28353728e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283537295 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.868877:0:15261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788832246.868883:0:13191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832246.868887:0:13191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b28353728e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283537295 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.868892:0:13191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c000 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832246.868895:0:13191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b28353728e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283537295 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.868901:0:13191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b28353728e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x998c12b283537295 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832246.868908:0:13191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b28353728e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x998c12b283537295 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832246.868915:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1788832246.868922:0:13191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788832246.868924:0:13191:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788832246.868926:0:13191:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788832246.868939:0:13191:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b28353728e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283537295 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.868947:0:13191:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832246.868962:0:13191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b28353728e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283537295 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832246.868968:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1788832246.868969:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b28353728e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283537295 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832246.868976:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218454784:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788832246.868981:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832246.868983:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832246.868985:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832246.868994:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218454912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832246.869003:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832246.869025:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832246.869057:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218454656 00000100:00100000:2.0:1788832246.869063:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218454656 00010000:00010000:3.0:1788832246.869070:0:15261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c0148aa00/0x998c12b283536ae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536aed expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.869078:0:15261:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c0148aa00/0x998c12b283536ae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536aed expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.869084:0:15261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c0148aa00/0x998c12b283536ae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283536aed expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.869090:0:15261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9d2c0148aa00/0x998c12b283536ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283536aed expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832246.869111:0:15261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788832246.869113:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218454784 10000000:01000000:3.0:1788832246.869114:0:15261:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000100:00100000:2.0:1788832246.869116:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218454784 10000000:01000000:3.0:1788832246.869118:0:15261:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:1.0:1788832246.869121:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218454912 00000100:00100000:1.0:1788832246.869128:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218454912 00000100:00100000:2.0:1788832246.869141:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000020:01000004:3.0:1788832246.869150:0:15261:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000100:00100000:2.0:1788832246.869151:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+25:3651:x1875726218454656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788832246.869164:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788832246.869171:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1788832246.869183:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c390f2a00/0x998c12b28353702d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x998c12b283537026 expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832246.869203:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832246.869239:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+24:3651:x1875726218454656:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832246.869245:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788832246.869262:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788832246.869269:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+23:3653:x1875726218454912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788832246.869276:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832246.869285:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2b07cff800/0x998c12b283537295 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x998c12b28353728e expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832246.869296:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832246.869321:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e55f0905-9d39-4464-9830-326b420fb582+22:3653:x1875726218454912:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832246.869327:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788832246.869361:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218454912:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788832246.869378:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832246.869382:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c0148aa00/0x998c12b283536ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283536aed expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832246.869388:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c0148aa00 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832246.869391:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c0148aa00/0x998c12b283536ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283536aed expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832246.869397:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c0148aa00/0x998c12b283536ae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x998c12b283536aed expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832246.869402:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c0148aa00/0x998c12b283536ae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x998c12b283536aed expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832246.869414:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788832246.869416:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788832246.869418:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788832246.869432:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c0148aa00/0x998c12b283536ae6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283536aed expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832246.869437:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832246.869459:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c0148aa00/0x998c12b283536ae6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283536aed expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832246.869464:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c0148aa00/0x998c12b283536ae6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283536aed expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832246.869474:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832246.869475:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832246.869477:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832246.869483:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788832246.869490:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218455040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832246.869515:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832246.869547:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218454656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832246.869564:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218455040 00000100:00100000:2.0:1788832246.869567:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218455040 00000100:00100000:2.0:1788832246.869591:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788832246.869598:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e55f0905-9d39-4464-9830-326b420fb582+22:3653:x1875726218455040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788832246.869605:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832246.869614:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c00031400/0x998c12b283536aed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x998c12b283536ae6 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1788832246.869646:0:15261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788832246.869651:0:15261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1788832246.869654:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:3.0:1788832246.869657:0:15261:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1788832246.869662:0:15261:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9d2b073a3800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788832246.869669:0:15261:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9d2b057dc800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788832246.869675:0:15261:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9d2c3e565800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788832246.869680:0:15261:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9d2c35b8f800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000100:00100000:2.0:1788832246.869681:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e55f0905-9d39-4464-9830-326b420fb582+21:3653:x1875726218455040:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832246.869687:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000020:00080000:3.0:1788832246.869688:0:15261:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9d2b076ea800 c5983f70-61a6-4df8-ba8a-04bd100176c7 192.168.203.26@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:1.0:1788832246.869688:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e55f0905-9d39-4464-9830-326b420fb582+25:3651:x1875726218454784:12345-0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788832246.869701:0:15261:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9d2b057da800 352fff76-09db-42cd-818a-16e788a01abb 192.168.203.26@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967523 stale:0 00000020:00080000:3.0:1788832246.869707:0:15261:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9d2c390819b8) has exports, disconnecting them 00010000:00010000:1.0:1788832246.869707:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788832246.869712:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218455040:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788832246.869715:0:15261:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d2b073a3800), last request at 1788832243 00000020:00000080:3.0:1788832246.869721:0:15261:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536e97 00010000:00010000:1.0:1788832246.869722:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c390f3a00/0x998c12b283536f31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x998c12b283536f2a expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832246.869736:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1788832246.869738:0:15261:0:(import.c:65:import_set_state_nolock()) ffff9d2b073a7800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788832246.869774:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e55f0905-9d39-4464-9830-326b420fb582+19:3651:x1875726218454784:12345-0@lo:103:ldlm_bl.0 Request processed in 594us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832246.869781:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000020:00080000:3.0:1788832246.869805:0:15261:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d2b073a3800): rc 0 00000020:00000080:3.0:1788832246.869808:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2b073a3800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788832246.869821:0:15261:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d2b057dc800), last request at 1788832243 00000100:00100000:1.0:1788832246.869825:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218454784:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788832246.869826:0:15261:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536d71 00000100:00080000:3.0:1788832246.869832:0:15261:0:(import.c:65:import_set_state_nolock()) ffff9d2b057d9000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788832246.869850:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788832246.869858:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b073a3800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:3.0:1788832246.869861:0:15261:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d2b057dc800): rc 0 00000020:00000080:3.0:1788832246.869865:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2b057dc800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788832246.869877:0:15261:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d2c3e565800), last request at 1788832022 00000020:00000080:3.0:1788832246.869882:0:15261:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536c6e 00000100:00080000:3.0:1788832246.869886:0:15261:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e560000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788832246.869899:0:15261:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d2c3e565800): rc 0 00000020:00000080:3.0:1788832246.869902:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2c3e565800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788832246.869902:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2b073a7800 for lustre-MDT0000 00000020:00080000:3.0:1788832246.869912:0:15261:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d2c35b8f800), last request at 1788832022 00000020:00000080:1.0:1788832246.869914:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b057dc800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788832246.869916:0:15261:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536c2f 00010000:00010000:2.0:1788832246.869917:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788832246.869923:0:15261:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e577800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788832246.869924:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832246.869943:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788832246.869944:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3e565800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788832246.869967:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2b057d9000 for lustre-MDT0000 00000020:00000080:1.0:1788832246.869970:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c3e560000 for lustre-MDT0000 00000001:00000004:3.0:1788832246.870618:0:15261:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000020:00080000:3.0:1788832246.870721:0:15261:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d2c35b8f800): rc 0 00000004:00000080:3.0:1788832246.870729:0:15261:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb56208023ae0 00000100:00080000:3.0:1788832246.870748:0:15261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788832246.870751:0:15261:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1788832246.874639:0:15261:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788832246.874669:0:15261:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e676800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788832246.874838:0:15261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788832246.874844:0:15261:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 3 00000004:00080000:3.0:1788832246.874858:0:15261:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788832246.874934:0:15261:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788832246.874945:0:15261:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e9ec000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788832246.874951:0:15261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788832246.874953:0:15261:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1788832246.874970:0:15261:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788832246.875028:0:15261:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788832246.875035:0:15261:0:(import.c:65:import_set_state_nolock()) ffff9d2b067ef800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788832246.875060:0:15261:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9d2c390819b8) has no exports 00000100:00100000:1.0:1788832246.875143:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218455168:0@lo:39:umount.0 00000100:00100000:1.0:1788832246.875284:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832246.875324:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218455296:0@lo:9:umount.0 00000100:00100000:1.0:1788832246.875352:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832246.875412:0:10099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218455296 00000100:00100000:3.0:1788832246.875420:0:10099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218455296 00000100:00100000:1.0:1788832246.875492:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218455424:0@lo:9:umount.0 00000100:00100000:1.0:1788832246.875518:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832246.875552:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218455424 00000100:00100000:1.0:1788832246.875556:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218455424 00000100:00100000:1.0:1788832246.875610:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788832246.875635:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875726218455424:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788832246.875661:0:10097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536f5b 00000100:00080000:1.0:1788832246.875670:0:10097:0:(import.c:65:import_set_state_nolock()) ffff9d2c3fd3d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788832246.875711:0:10097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788832246.875734:0:10099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788832246.875743:0:10099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1875726218455296:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788832246.875759:0:10099:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536e19 00000100:00080000:3.0:1788832246.875766:0:10099:0:(import.c:65:import_set_state_nolock()) ffff9d2b06005800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788832246.875871:0:10099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:3.0:1788832246.876176:0:10099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3650:x1875726218455296:12345-0@lo:9:umount.0 Request processed in 433us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832246.876183:0:10099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788832246.876207:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218455168 00000100:00100000:3.0:1788832246.876211:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218455168 00000100:00100000:3.0:1788832246.876238:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788832246.876246:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0857ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875726218455168:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788832246.876263:0:7934:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536cde 00000100:00080000:3.0:1788832246.876268:0:7934:0:(import.c:65:import_set_state_nolock()) ffff9d2c36bfc800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788832246.876285:0:7934:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788832246.876373:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3650:x1875726218455168:12345-0@lo:39:umount.0 Request processed in 128us (1089us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788832246.876379:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00010000:00010000:3.0:1788832246.876414:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832246.876424:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788832246.876458:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788832246.876462:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788832246.877323:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0857d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3650:x1875726218455424:12345-0@lo:9:umount.0 Request processed in 1702us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832246.877332:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:2.0:1788832246.878197:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788832246.883504:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e676800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788832246.883521:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218455168:0@lo:39:umount.0 00000100:00080000:1.0:1788832246.883537:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e9ec000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788832246.883563:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788832246.883565:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788832246.883569:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218455296:0@lo:9:umount.0 00000100:00080000:1.0:1788832246.883584:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2b067ef800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788832246.883597:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788832246.883599:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788832246.883601:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218455424:0@lo:9:umount.0 00000020:00080000:2.0:1788832246.890357:0:15261:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9d2c390819b8) has no exports 00000020:00000080:2.0:1788832246.949088:0:15261:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536b41 00000020:00000080:2.0:1788832246.949103:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2c3d6f6800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788832246.949124:0:15261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788832246.949287:0:15261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788832246.949297:0:15261:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788832246.949302:0:15261:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9d2c18e33370) has no exports 00000020:00000080:0.0:1788832246.949462:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3d6f6800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788832246.950071:0:15261:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536b3a 00000020:00000080:3.0:1788832246.950079:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2c3d6f7000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788832246.950132:0:15261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788832246.950140:0:15261:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788832246.950156:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2c182c2000/lustre-QMT0000_UUID 00000020:00000080:3.0:1788832246.950159:0:15261:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c182c2000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788832246.950167:0:15261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788832246.950323:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3d6f7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788832247.255198:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832248.023173:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218455552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788832248.023244:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832248.023456:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218455552 00000100:00100000:0.0:1788832248.023465:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218455552 00000100:00100000:0.0:1788832248.023511:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788832248.023520:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1875726218455552:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1788832248.023528:0:6531:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788832248.023581:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3651:x1875726218455552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (335us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788832248.023589:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:02020000:2.0:1788832248.023758:0:3651:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1788832248.035670:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788832248.035680:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9d2c3c7a7000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788832248.035685:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788832248.058176:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9d2c3c7a7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788832248.058190:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 162 00000100:00080000:2.0:1788832248.058202:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9d2c3c7a7000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788832248.058269:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b07f35c00 x1875726218455680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788832248.059314:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218455680:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788832248.059396:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832248.059767:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218455680 00000100:00100000:3.0:1788832248.059778:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218455680 00000100:00100000:3.0:1788832248.059823:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788832248.059832:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1875726218455680:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788832248.059851:0:6530:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788832248.069367:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1875726218455680:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 9527us (9962us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788832248.069382:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:1.0:1788832248.073493:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3c7a7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788832248.073505:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788832248.073510:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218455680:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:3.0:1788832248.282519:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832248.535477:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218455936:0@lo:400:kworker.0 00000100:00100000:2.0:1788832248.535531:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218456064:0@lo:400:kworker.0 00000100:00100000:0.0:1788832248.535549:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832248.535642:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218455936 00000100:00100000:1.0:1788832248.535651:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218455936 00000100:00100000:1.0:1788832248.535696:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788832248.535704:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3653:x1875726218455936:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788832248.535712:0:6525:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788832248.535799:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218455808:0@lo:400:kworker.0 00000100:00100000:2.0:1788832248.537183:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832248.537256:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218456576:0@lo:400:kworker.0 00000100:00100000:2.0:1788832248.537479:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832248.537688:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218456064 00000100:00100000:2.0:1788832248.537696:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218456064 00000100:00100000:2.0:1788832248.537730:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218456576 00000100:00100000:2.0:1788832248.537733:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218456576 00000100:00100000:2.0:1788832248.538027:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788832248.538040:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218456576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832248.538101:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1875726218456576:12345-0@lo:400:kworker.0 Request processed in 64us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832248.538109:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788832248.538126:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788832248.538131:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875726218456064:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788832248.538136:0:8742:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788832248.538163:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3654:x1875726218456064:12345-0@lo:400:kworker.0 Request processed in 31us (985us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788832248.538168:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1788832248.538192:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788832248.538223:0:3654:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788832248.538228:0:3654:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e9ee800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788832248.538232:0:3654:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1788832248.540151:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3653:x1875726218455936:12345-0@lo:400:kworker.0 Request processed in 4438us (4596us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788832248.540165:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788832248.540237:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218456192:0@lo:400:kworker.0 00000100:00100000:1.0:1788832248.540279:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832248.540314:0:8742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218456192 00000100:00100000:1.0:1788832248.540321:0:8742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218456192 00000100:00100000:1.0:1788832248.540369:0:8742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788832248.540377:0:8742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218456192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832248.540422:0:8742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218456192:12345-0@lo:400:kworker.0 Request processed in 46us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832248.540458:0:8742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00080000:1.0:1788832248.540481:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788832248.544133:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b08550700 x1875726218456192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832248.544155:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218456192:0@lo:400:kworker.0 00000100:00100000:1.0:1788832248.544168:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218456704:0@lo:400:kworker.0 00000100:00100000:1.0:1788832248.544235:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832248.544336:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218456704 00000100:00100000:1.0:1788832248.544342:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218456704 00000100:00100000:1.0:1788832248.544402:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788832248.544411:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218456704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832248.544478:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218456704:12345-0@lo:400:kworker.0 Request processed in 69us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832248.544485:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:1.0:1788832248.544505:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788832248.544526:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218456704:0@lo:400:kworker.0 00000100:00080000:0.0:1788832248.547317:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788832248.547326:0:3653:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e574800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788832248.547329:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788832248.547334:0:3653:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e574800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788832248.547337:0:3653:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 162 00000100:00080000:0.0:1788832248.547345:0:3653:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9d2c3e574800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788832248.547378:0:3653:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c3fc06300 x1875726218456832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788832248.547481:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875726218456832:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788832248.547533:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832248.547577:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218455936:0@lo:400:kworker.0 00000100:00100000:0.0:1788832248.547586:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218456448:0@lo:400:kworker.0 00000100:00100000:0.0:1788832248.547788:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832248.547858:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218456832 00000100:00100000:0.0:1788832248.547865:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218456832 00000100:00100000:0.0:1788832248.548115:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218456448 00000100:00100000:0.0:1788832248.548120:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218456448 00000100:00100000:0.0:1788832248.548145:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788832248.548152:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1875726218456832:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1788832248.548169:0:6525:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788832248.550292:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832248.550346:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218455808 00000100:00100000:3.0:1788832248.550354:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218455808 00000100:00100000:3.0:1788832248.550401:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788832248.550410:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c39023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+19:3652:x1875726218455808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832248.550472:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c39023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e55f0905-9d39-4464-9830-326b420fb582+19:3652:x1875726218455808:12345-0@lo:400:kworker.0 Request processed in 64us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832248.550479:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788832248.550539:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e55f0905-9d39-4464-9830-326b420fb582:3652:1875726218455808:0@lo:400:kworker.0 00000100:00100000:3.0:1788832248.550552:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218456320:0@lo:400:kworker.0 00000100:00100000:3.0:1788832248.550590:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832248.550614:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218456320 00000100:00100000:3.0:1788832248.550633:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218456320 00000100:00100000:3.0:1788832248.550681:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788832248.550687:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218456320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832248.550718:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218456320:12345-0@lo:400:kworker.0 Request processed in 32us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832248.550724:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:3.0:1788832248.550737:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788832248.550757:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218456320:0@lo:400:kworker.0 00000100:00100000:3.0:1788832248.550810:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788832248.550816:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3653:x1875726218456448:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788832248.550822:0:13811:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788832248.550858:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3653:x1875726218456448:12345-0@lo:400:kworker.0 Request processed in 41us (3070us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788832248.550863:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:3.0:1788832248.550909:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788832248.550915:0:3653:0:(import.c:65:import_set_state_nolock()) ffff9d2b057ea800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788832248.550918:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788832248.550924:0:3653:0:(import.c:65:import_set_state_nolock()) ffff9d2b057ea800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788832248.550928:0:3653:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 200 00000100:00080000:3.0:1788832248.550933:0:3653:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d2b057ea800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788832248.550959:0:3653:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c3fd0c380 x1875726218456960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788832248.550976:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218456448:0@lo:400:kworker.0 00000100:00080000:1.0:1788832248.552256:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e574800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1788832248.552256:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1875726218456832:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 4097us (4716us total) trans 0 rc -19/-19 00000100:00080000:1.0:1788832248.552262:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788832248.552265:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875726218456832:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788832248.552267:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788832248.552342:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1875726218456960:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788832248.552385:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832248.552462:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218456960 00000100:00100000:3.0:1788832248.552468:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218456960 00000100:00100000:3.0:1788832248.552504:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788832248.552517:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1875726218456960:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788832248.552533:0:6527:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788832248.552582:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1875726218456960:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 65us (195us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788832248.552589:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1788832248.553597:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2b057ea800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788832248.553603:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788832248.553607:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1875726218456960:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1788832248.565601:0:3654:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e9ee800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788832248.565617:0:3654:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 181 00000100:00080000:2.0:1788832248.565641:0:3654:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d2c3e9ee800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788832248.565690:0:3654:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b07f36680 x1875726218457088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788832248.565736:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1875726218456064:0@lo:400:kworker.0 00010000:00080000:2.0:1788832248.565769:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b08553480 x1875726218456576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832248.565782:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218456576:0@lo:400:kworker.0 00000100:00100000:1.0:1788832248.566188:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1875726218457088:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788832248.566263:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832248.566557:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218457088 00000100:00100000:3.0:1788832248.566565:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218457088 00000100:00100000:3.0:1788832248.566614:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788832248.566657:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1875726218457088:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1788832248.566674:0:6526:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788832248.589789:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1875726218457088:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 23124us (23518us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788832248.589804:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1788832248.590001:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e9ee800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788832248.590008:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788832248.590012:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1875726218457088:0@lo:38:ptlrpcd_00_03.0 00000040:00080000:3.0:1788832248.730287:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788832249.047234:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788832249.047264:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218457216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788832249.047473:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832249.048171:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218457216 00000100:00100000:3.0:1788832249.048180:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218457216 00000100:00100000:3.0:1788832249.048232:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788832249.048252:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218457216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788832249.048282:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788832249.048340:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218457216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832249.048348:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788832249.048395:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218457216:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1788832249.051197:0:6504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788832249.051204:0:6504:0:(genops.c:885:class_export_put()) final put ffff9d2c35b8f800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788832249.051238:0:6504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c5983f70-61a6-4df8-ba8a-04bd100176c7 00000001:00080000:1.0:1788832249.051257:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:1.0:1788832249.051260:0:6504:0:(genops.c:885:class_export_put()) final put ffff9d2b076ea800/c5983f70-61a6-4df8-ba8a-04bd100176c7 00000001:00100000:1.0:1788832249.051267:0:6504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 352fff76-09db-42cd-818a-16e788a01abb 00000001:00080000:1.0:1788832249.051271:0:6504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1788832249.051277:0:6504:0:(genops.c:885:class_export_put()) final put ffff9d2b057da800/352fff76-09db-42cd-818a-16e788a01abb 00000020:00000080:0.0:1788832249.051409:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c35b8f800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788832249.051469:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b076ea800/c5983f70-61a6-4df8-ba8a-04bd100176c7 for lustre-MDT0000 00000020:00000080:0.0:1788832249.051494:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b057da800/352fff76-09db-42cd-818a-16e788a01abb for lustre-MDT0000 00000020:00000080:0.0:1788832249.051525:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c3e577800 for lustre-MDT0000 00000020:00000080:0.0:1788832249.051529:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2b076ee800 for lustre-MDT0000 00000020:00000080:0.0:1788832249.051533:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2b057da000 for lustre-MDT0000 00000001:00100000:2.0:1788832249.056287:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788832249.056297:0:8434:0:(genops.c:885:class_export_put()) final put ffff9d2b06000000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788832249.056324:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 352fff76-09db-42cd-818a-16e788a01abb 00000020:00000080:2.0:1788832249.056327:0:8434:0:(genops.c:885:class_export_put()) final put ffff9d2c050ce800/352fff76-09db-42cd-818a-16e788a01abb 00000020:00000080:1.0:1788832249.056392:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b06000000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788832249.056451:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c050ce800/352fff76-09db-42cd-818a-16e788a01abb for lustre-OST0000 00000020:00000080:1.0:1788832249.056469:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2b06005800 for lustre-OST0000 00000020:00000080:1.0:1788832249.056474:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c050c9000 for lustre-OST0000 00000001:00100000:3.0:1788832249.056825:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788832249.056835:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1788832249.056839:0:7456:0:(genops.c:885:class_export_put()) final put ffff9d2c36c49000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788832249.056857:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c5983f70-61a6-4df8-ba8a-04bd100176c7 00000001:00080000:3.0:1788832249.056877:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1788832249.056880:0:7456:0:(genops.c:885:class_export_put()) final put ffff9d2b067ea000/c5983f70-61a6-4df8-ba8a-04bd100176c7 00000001:00100000:3.0:1788832249.056885:0:7456:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 352fff76-09db-42cd-818a-16e788a01abb 00000001:00080000:3.0:1788832249.056889:0:7456:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1788832249.056891:0:7456:0:(genops.c:885:class_export_put()) final put ffff9d2c3fc37000/352fff76-09db-42cd-818a-16e788a01abb 00000020:00000080:0.0:1788832249.056945:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c36c49000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788832249.056991:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b067ea000/c5983f70-61a6-4df8-ba8a-04bd100176c7 for lustre-MDT0001 00000020:00000080:0.0:1788832249.057013:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3fc37000/352fff76-09db-42cd-818a-16e788a01abb for lustre-MDT0001 00000020:00000080:0.0:1788832249.057034:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c36bfc800 for lustre-MDT0001 00000020:00000080:0.0:1788832249.057039:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c36d27800 for lustre-MDT0001 00000020:00000080:0.0:1788832249.057042:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c3fc33000 for lustre-MDT0001 00000001:00100000:0.0:1788832249.058695:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788832249.058715:0:9518:0:(genops.c:885:class_export_put()) final put ffff9d2c3fd3a000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788832249.058742:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 352fff76-09db-42cd-818a-16e788a01abb 00000020:00000080:0.0:1788832249.058745:0:9518:0:(genops.c:885:class_export_put()) final put ffff9d2c3fc32800/352fff76-09db-42cd-818a-16e788a01abb 00000020:00000080:1.0:1788832249.058822:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3fd3a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788832249.058865:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3fc32800/352fff76-09db-42cd-818a-16e788a01abb for lustre-OST0001 00000020:00000080:1.0:1788832249.058880:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c3fd3d800 for lustre-OST0001 00000020:00000080:1.0:1788832249.058892:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c3fc30000 for lustre-OST0001 00010000:00010000:2.0:1788832249.303720:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832249.559443:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218457344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788832249.559521:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832249.559937:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218457344 00000100:00100000:0.0:1788832249.559946:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218457344 00000100:00100000:0.0:1788832249.560008:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788832249.560028:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218457344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788832249.560065:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788832249.560126:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218457344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832249.560133:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788832249.560313:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218457344:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788832250.327719:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832251.351900:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832252.374900:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788832253.015540:0:15261:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d2c36dd6d80 - data ffff9d2c31757438/ffff9d2c36d65400 00000020:01000000:3.0:1788832253.015725:0:15261:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d2c087e6de0 - data ffff9d2c315865e8/ffff9d2c35918400 00000001:00000004:3.0:1788832253.024166:0:15261:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:2.0:1788832253.084368:0:15261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788832253.084377:0:15261:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788832253.084394:0:15261:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9d2c3fd0ea00 x1875726218455168/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788832256 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832253.084430:0:15261:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788832253.086819:0:15261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788832253.086826:0:15261:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 4 00000004:00080000:2.0:1788832253.086837:0:15261:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788832253.086839:0:15261:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788832253.087246:0:8918:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788832253.087262:0:8918:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788832253.087273:0:8918:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788832253.087834:0:15261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788832253.087839:0:15261:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1788832253.087858:0:15261:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788832253.087861:0:15261:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788832253.088114:0:10092:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788832253.088119:0:10092:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1788832253.088126:0:10092:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788832253.093204:0:15261:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536b09 00000020:00000080:2.0:1788832253.093222:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2c182e5800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788832253.097485:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c182e5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788832253.099920:0:15261:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536b1e 00000020:00000080:2.0:1788832253.099931:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2c1fe59800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788832253.099959:0:15261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788832253.099964:0:15261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788832253.099973:0:15261:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788832253.099977:0:15261:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9d2c39080000) has no exports 00000020:00000080:1.0:1788832253.100096:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c1fe59800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1788832253.103686:0:15261:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788832253.103706:0:15261:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536f54 00000020:00000080:1.0:1788832253.103718:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2b067ee000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788832253.103739:0:15261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788832253.103746:0:15261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788832253.103762:0:15261:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788832253.103766:0:15261:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9d2c3fd199b8) has no exports 00000020:00000080:1.0:1788832253.103776:0:15261:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536f4d 00000020:00000080:1.0:1788832253.103780:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2b067ee800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788832253.104109:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b067ee000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788832253.104119:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b067ee800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788832253.104286:0:15261:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788832253.104291:0:15261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788832253.104294:0:15261:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1788832253.104299:0:15261:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788832253.104302:0:15261:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788832253.104387:0:15261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788832253.104405:0:15261:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788832253.104412:0:15261:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536e12 00000020:00000080:1.0:1788832253.104416:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2c3fc6a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788832253.105485:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2b067ef800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788832253.105500:0:36:0:(genops.c:885:class_export_put()) final put ffff9d2b067e9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788832253.105504:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b067e9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788832253.105512:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788832253.105690:0:15261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788832253.105697:0:15261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788832253.105710:0:15261:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788832253.105715:0:15261:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9d2b060099b8) has no exports 00000020:00000080:1.0:1788832253.105724:0:15261:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536e0b 00000020:00000080:1.0:1788832253.105730:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2c3e9ea800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788832253.106087:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3fc6a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788832253.109500:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3e9ea800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788832253.109783:0:15261:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788832253.109788:0:15261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788832253.109792:0:15261:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 5 00000004:00080000:1.0:1788832253.109799:0:15261:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788832253.109801:0:15261:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788832253.109928:0:15261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788832253.109945:0:15261:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788832253.109961:0:15261:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788832253.109969:0:15261:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536cd7 00000020:00000080:1.0:1788832253.109979:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2c3e71d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788832253.112558:0:15261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788832253.112574:0:15261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788832253.112586:0:15261:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788832253.112591:0:15261:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9d2c3e7799b8) has no exports 00000020:00000080:1.0:1788832253.112601:0:15261:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536cd0 00000020:00000080:1.0:1788832253.112610:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2c3e672800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788832253.113080:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c3e9ec000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788832253.113089:0:36:0:(genops.c:885:class_export_put()) final put ffff9d2c3e9ef000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788832253.113092:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3e9ef000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788832253.113098:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788832253.113176:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3e71d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788832253.113180:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3e672800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788832253.121673:0:15261:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788832253.121682:0:15261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788832253.121687:0:15261:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788832253.121695:0:15261:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788832253.121742:0:15261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788832253.121755:0:15261:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788832253.121785:0:15261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788832253.121789:0:15261:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788832253.121795:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2c182e3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788832253.121800:0:15261:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c182e3800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788832253.121810:0:15261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788832253.121910:0:15261:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536b25 00000020:00000080:0.0:1788832253.121916:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2c1fe5b000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788832253.121921:0:15261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788832253.121925:0:15261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788832253.121938:0:15261:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788832253.121942:0:15261:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9d2c39083370) has no exports 00000020:00000080:0.0:1788832253.121961:0:15261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788832253.121964:0:15261:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788832253.121968:0:15261:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536b2c 00000020:00000080:0.0:1788832253.121972:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2c1fe59000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788832253.121980:0:15261:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d2c40623800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788832253.121983:0:15261:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d2c40623800 3 00000020:01000004:0.0:1788832253.121986:0:15261:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d2c40623800 from lustre-MDT0000 00000020:00000080:0.0:1788832253.122017:0:15261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788832253.122020:0:15261:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788832253.122023:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2c182e2000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788832253.122025:0:15261:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c182e2000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788832253.122032:0:15261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788832253.122061:0:15261:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788832253.122065:0:15261:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788832253.122067:0:15261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788832253.122070:0:15261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788832253.122072:0:15261:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788832253.122079:0:15261:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9d2c09c2c000 e55f0905-9d39-4464-9830-326b420fb582 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788832253.122085:0:15261:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9d2c39084d28) has exports, disconnecting them 00000020:00080000:0.0:1788832253.122089:0:15261:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9d2c09c2c000), last request at 1788832003 00000020:00000080:0.0:1788832253.122102:0:15261:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536aca 00000020:00010000:0.0:1788832253.122106:0:15261:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9d2c09c2c000: total 2 00000100:00080000:0.0:1788832253.122110:0:15261:0:(import.c:65:import_set_state_nolock()) ffff9d2c09c2e000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788832253.122130:0:15261:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d2c09c2c000): rc 0 00000020:00080000:0.0:1788832253.122134:0:15261:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9d2c39084d28) has no exports 00000100:00100000:2.0:1788832253.122435:0:6519:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9d2c348c3c00:6519] 2 exiting: rc = 0 00000020:00000080:2.0:1788832253.122582:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c3e676800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788832253.122590:0:36:0:(genops.c:885:class_export_put()) final put ffff9d2c3e674000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788832253.122592:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3e674000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788832253.122596:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788832253.122660:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c1fe5b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788832253.122664:0:36:0:(genops.c:885:class_export_put()) final put ffff9d2c182e5000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788832253.122666:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c182e5000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788832253.122669:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788832253.122701:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c1fe59000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:3.0:1788832253.122893:0:6513:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9d2c09c2c000: total 0 00010000:00010000:3.0:1788832253.122936:0:6513:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9d2c09c2c000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788832253.122971:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c390f3200/0x998c12b283536ff5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x998c12b283536fee expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832253.122986:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c092dde00/0x998c12b283537003 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x998c12b283536ffc expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832253.122996:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c36db8a00/0x998c12b283537011 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x998c12b28353700a expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832253.123006:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c390f2c00/0x998c12b283536bc6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x998c12b283536bbf expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832253.123020:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c4204b400/0x998c12b283536bd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x998c12b283536bcd expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832253.123044:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c421d3600/0x998c12b28353726b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x998c12b283537264 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832253.123055:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c092dd000/0x998c12b28353703b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x998c12b283537034 expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832253.123064:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c36db9e00/0x998c12b283536fcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x998c12b283536fc4 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832253.123074:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2b07cfe400/0x998c12b283537279 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x998c12b283537272 expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832253.123083:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c421d2e00/0x998c12b283537287 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x998c12b283537280 expref: 5 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832253.123098:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c36db9600/0x998c12b283536fd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x998c12b283536fd2 expref: 4 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832253.123107:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c092dcc00/0x998c12b283536eeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x998c12b283536ee4 expref: 3 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832253.123123:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c390f3e00/0x998c12b283536fe7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x998c12b283536fe0 expref: 2 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832253.123133:0:6513:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9d2c09c2c000, canceled 13 locks, left on hash table 0. 00000100:00100000:2.0:1788832253.123740:0:6518:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9d2c05e33600:6518] 1 exiting: rc = 0 00000100:00100000:2.0:1788832253.123816:0:6517:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9d2c0318c600:6517] 0 exiting: rc = 1 00000020:00000080:3.0:1788832253.124999:0:6513:0:(genops.c:885:class_export_put()) final put ffff9d2c09c2c000/e55f0905-9d39-4464-9830-326b420fb582 00010000:00010000:3.0:1788832253.125023:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832253.125026:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832253.125029:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788832253.125079:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c09c2c000/e55f0905-9d39-4464-9830-326b420fb582 for MGS 00000020:00000080:2.0:1788832253.125119:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c09c2e000 for MGS 00000100:00100000:0.0:1788832253.125189:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125199:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125205:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125211:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125217:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125233:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125240:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125246:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125251:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125408:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125415:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125420:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125427:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125432:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125437:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125443:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125448:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125454:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125459:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125465:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125470:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125476:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125482:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125488:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125493:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125498:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125504:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125509:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125515:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125521:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125527:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125533:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125538:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125543:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125548:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125554:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125559:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125564:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125569:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125574:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125587:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125592:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125598:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125603:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125607:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125613:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125852:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125862:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125866:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125872:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125877:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125883:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125888:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125893:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125898:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125904:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125910:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125915:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125921:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125926:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125932:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125937:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125942:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832253.125948:0:15261:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788832253.126985:0:15261:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d2c36dd66c0 - data ffff9d2c31757000/ffff9d2c36d66000 00000020:01000000:0.0:1788832253.127152:0:15261:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d2c030279c0 - data ffff9d2c3141fd80/ffff9d2c09261400 00000020:00000080:0.0:1788832253.127726:0:15261:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536aae 00000020:00000080:0.0:1788832253.127734:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2c40625800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788832253.127748:0:15261:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d2c40623800 from MGS, refs=2 00000020:01000004:0.0:1788832253.127752:0:15261:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d2c40623800 2 00000020:01000004:0.0:1788832253.127755:0:15261:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d2c40623800 from MGS 00000020:00000080:0.0:1788832253.127780:0:15261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788832253.127786:0:15261:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788832253.127789:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2c40620000/MGS 00000020:00000080:0.0:1788832253.127803:0:15261:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c40620000/MGS for MGS 00000020:01000000:0.0:1788832253.127809:0:15261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788832253.127872:0:15261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788832253.127876:0:15261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788832253.127882:0:15261:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788832253.127887:0:15261:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9d2c1fe5d800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788832253.127893:0:15261:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9d2c3582b370) has exports, disconnecting them 00000020:00080000:0.0:1788832253.127898:0:15261:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9d2c1fe5d800), last request at 1788832004 00000020:00000080:0.0:1788832253.127901:0:15261:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536b79 00000020:00080000:0.0:1788832253.127909:0:15261:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d2c1fe5d800): rc 0 00000020:00000080:0.0:1788832253.127913:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2c1fe5d800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788832253.128794:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c40625800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788832253.128805:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c1fe5d800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788832253.132685:0:15261:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788832253.132694:0:15261:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788832253.132698:0:15261:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788832253.132704:0:15261:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788832253.132734:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c1fe5a000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788832253.132921:0:15261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788832253.132930:0:15261:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788832253.132936:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2c1fe5a800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788832253.132940:0:15261:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c1fe5a800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788832253.132946:0:15261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788832253.133033:0:15261:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d2c40623800 1 00000020:00000080:2.0:1788832253.133039:0:15261:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536aa0 00000020:00000080:2.0:1788832253.133046:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2c40620800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788832253.133054:0:15261:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788832253.133062:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c40620800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788832253.133071:0:15261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788832253.133076:0:15261:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788832253.133080:0:15261:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9d2c18e30000) has no exports 00000020:00000080:2.0:1788832253.177379:0:15261:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788832253.177394:0:15261:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788832253.177409:0:15261:0:(genops.c:885:class_export_put()) final put ffff9d2c390c3800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788832253.177414:0:15261:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c390c3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788832253.177431:0:15261:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788832253.177557:0:15261:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d2c40622800 00000020:02000400:2.0:1788832253.177843:0:15261:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788832253.410646:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788832253.654791:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788832253.654798:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788832253.654802:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d2c3c7a7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788832253.654810:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 388 00000100:00080000:0.0:1788832253.654815:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788832253.654822:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9d2c3c7a7000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788832253.654846:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c3fc06d80 x1875726218457600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788832253.654862:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788832253.654865:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788832253.654867:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e574800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788832253.654870:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 388 00000100:00080000:0.0:1788832253.654873:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788832253.654876:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9d2c3e574800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788832253.654888:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c3fc07b80 x1875726218457728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788832253.654907:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788832253.654910:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788832253.654912:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e9ee800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788832253.654915:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 388 00000100:00080000:0.0:1788832253.654918:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788832253.654922:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d2c3e9ee800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788832253.654934:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c3fc05c00 x1875726218457856/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788832253.654964:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788832253.654967:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788832253.654969:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d2b057ea800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788832253.654972:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 388 00000100:00080000:0.0:1788832253.654974:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788832253.654978:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d2b057ea800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788832253.654989:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c3fc06300 x1875726218458240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788832253.655028:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218458368:0@lo:400:kworker.0 00000100:00100000:0.0:1788832253.655088:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832253.655142:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788832253.655149:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218457472:0@lo:400:kworker.0 00000400:00000100:0.0:1788832253.655169:0:3653:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875726218457472 offset 0 length 224: 4 00000100:00100000:0.0:1788832253.655188:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218458496:0@lo:400:kworker.0 00000100:00100000:0.0:1788832253.655210:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832253.655247:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218457600:0@lo:38:kworker.0 00000100:00100000:0.0:1788832253.655278:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832253.655293:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875726218457728:0@lo:38:kworker.0 00000100:00100000:0.0:1788832253.655315:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832253.655329:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1875726218457856:0@lo:38:kworker.0 00000100:00100000:0.0:1788832253.655350:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832253.655366:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1875726218458240:0@lo:38:kworker.0 00000100:00100000:0.0:1788832253.655385:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832253.655429:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218457984:0@lo:400:kworker.0 00000100:00100000:0.0:1788832253.655452:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832253.655470:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788832253.655477:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218458112:0@lo:400:kworker.0 00000100:00100000:0.0:1788832253.655498:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832253.655533:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218458368 00000100:00100000:0.0:1788832253.655541:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218458368 00000100:00100000:0.0:1788832253.655584:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218457728 00000100:00100000:0.0:1788832253.655587:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218457728 00000100:00100000:0.0:1788832253.655595:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218457856 00000100:00100000:0.0:1788832253.655597:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218457856 00000100:00100000:0.0:1788832253.655603:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218458240 00000100:00100000:0.0:1788832253.655605:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218458240 00000100:00100000:0.0:1788832253.655611:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218457984 00000100:00100000:0.0:1788832253.655613:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218457984 00000100:00100000:0.0:1788832253.655662:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788832253.655670:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218458368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832253.655717:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218458368:12345-0@lo:400:kworker.0 Request processed in 47us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832253.655724:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788832253.655746:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788832253.655751:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218457984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832253.655784:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218457984:12345-0@lo:400:kworker.0 Request processed in 33us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832253.655790:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788832253.655801:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788832253.655806:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1875726218457728:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788832253.655821:0:6525:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788832253.655850:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1875726218457728:12345-0@lo:38:kworker.0 Request processed in 43us (535us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788832253.655856:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788832253.655867:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788832253.655871:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1875726218457856:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788832253.655879:0:6525:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788832253.655901:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1875726218457856:12345-0@lo:38:kworker.0 Request processed in 29us (550us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788832253.655906:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788832253.655916:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788832253.655920:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1875726218458240:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788832253.655928:0:6525:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788832253.655949:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1875726218458240:12345-0@lo:38:kworker.0 Request processed in 27us (563us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788832253.655954:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788832253.655971:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218458496 00000100:00100000:0.0:1788832253.655975:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218458496 00000100:00100000:0.0:1788832253.656009:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218458112 00000100:00100000:0.0:1788832253.656012:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218458112 00000100:00100000:0.0:1788832253.656029:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788832253.656035:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218458496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832253.656067:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218458496:12345-0@lo:400:kworker.0 Request processed in 32us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832253.656073:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788832253.656083:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788832253.656088:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218458112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832253.656114:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218458112:12345-0@lo:400:kworker.0 Request processed in 26us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832253.656120:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788832253.656165:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218458112:0@lo:400:kworker.0 00010000:00080000:0.0:1788832253.656177:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9d2c3fc04a80 x1875726218457984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832253.656186:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218457984:0@lo:400:kworker.0 00000100:00080000:0.0:1788832253.656214:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e574800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788832253.656218:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788832253.656221:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875726218457728:0@lo:38:kworker.0 00000100:00080000:0.0:1788832253.656228:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e9ee800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788832253.656232:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788832253.656234:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1875726218457856:0@lo:38:kworker.0 00000100:00080000:0.0:1788832253.656242:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2b057ea800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788832253.656245:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788832253.656255:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1875726218458240:0@lo:38:kworker.0 00000100:00100000:0.0:1788832253.656284:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218458496:0@lo:400:kworker.0 00010000:00080000:0.0:1788832253.656295:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9d2c3fc04700 x1875726218458368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832253.656302:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218458368:0@lo:400:kworker.0 00000100:00100000:3.0:1788832253.656527:0:7934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218457600 00000100:00100000:3.0:1788832253.656532:0:7934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218457600 00000100:00100000:3.0:1788832253.656551:0:7934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788832253.656556:0:7934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c09260c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3650:x1875726218457600:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788832253.656566:0:7934:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788832253.656614:0:7934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c09260c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3650:x1875726218457600:12345-0@lo:38:kworker.0 Request processed in 57us (1335us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788832253.656642:0:7934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:3.0:1788832253.656986:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788832253.656990:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788832253.656992:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788832253.657126:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3c7a7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788832253.657131:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788832253.657134:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218457600:0@lo:38:kworker.0 00000100:00100000:1.0:1788832254.166926:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218458624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788832254.166990:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832254.167071:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218458624 00000100:00100000:1.0:1788832254.167078:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218458624 00000100:00100000:1.0:1788832254.167119:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788832254.167138:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218458624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788832254.167166:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788832254.167208:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218458624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832254.167215:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788832254.167257:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218458624:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788832254.422784:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832254.679004:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788832254.679026:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218458752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788832254.679094:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832254.679368:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218458752 00000100:00100000:1.0:1788832254.679376:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218458752 00000100:00100000:1.0:1788832254.679449:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788832254.679459:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218458752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788832254.679488:0:8443:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788832254.679549:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218458752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832254.679555:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788832254.679599:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218458752:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788832255.447528:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832256.472044:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788832256.707247:0:15462:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788832256.719208:0:15462:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1788832256.719262:0:15462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8c00/0x998c12b283536ffc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537003 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.719277:0:15462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8c00/0x998c12b283536ffc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283537003 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.719284:0:15462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8c00/0x998c12b283536ffc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283537003 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.719291:0:15462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8c00/0x998c12b283536ffc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283537003 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.719332:0:15462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788832256.719338:0:15462:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788832256.719366:0:15462:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788832256.719370:0:15462:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788832256.719391:0:15462:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788832256.719398:0:15462:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e574800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788832256.719404:0:15462:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788832256.719405:0:15462:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788832256.719408:0:15462:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788832256.719917:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832256.719926:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8c00/0x998c12b283536ffc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283537003 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832256.719934:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c36db8c00 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832256.719938:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8c00/0x998c12b283536ffc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283537003 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832256.719947:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8c00/0x998c12b283536ffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x998c12b283537003 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832256.719955:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8c00/0x998c12b283536ffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x998c12b283537003 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832256.719960:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788832256.719963:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788832256.719965:0:6514:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788832256.720013:0:6514:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8c00/0x998c12b283536ffc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283537003 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832256.720019:0:6514:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832256.720044:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8c00/0x998c12b283536ffc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283537003 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832256.720052:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8c00/0x998c12b283536ffc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283537003 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832256.720072:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832256.720074:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832256.720075:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832256.720098:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218458880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832256.720173:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832256.720242:0:10343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218458880 00000100:00100000:2.0:1788832256.720249:0:10343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218458880 00000100:00100000:2.0:1788832256.720286:0:10343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788832256.720293:0:10343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c09479850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3653:x1875726218458880:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788832256.720300:0:10343:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788832256 with bad export cookie 11064238942459226826 00010000:00010000:3.0:1788832256.723940:0:15462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2000/0x998c12b28353700a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537011 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.723956:0:15462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2000/0x998c12b28353700a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283537011 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.723965:0:15462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2000/0x998c12b28353700a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283537011 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.723972:0:15462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2000/0x998c12b28353700a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283537011 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.723991:0:15462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788832256.724001:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832256.724008:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2000/0x998c12b28353700a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283537011 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724016:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c390f2000 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832256.724020:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2000/0x998c12b28353700a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283537011 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724040:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2000/0x998c12b28353700a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x998c12b283537011 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832256.724048:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2000/0x998c12b28353700a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x998c12b283537011 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832256.724053:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788832256.724056:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1788832256.724087:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2000/0x998c12b28353700a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283537011 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724092:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832256.724124:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2000/0x998c12b28353700a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283537011 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724131:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2000/0x998c12b28353700a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283537011 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724142:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832256.724143:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832256.724145:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832256.724155:0:15462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8600/0x998c12b283536ee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536eeb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724163:0:15462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8600/0x998c12b283536ee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536eeb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724170:0:15462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8600/0x998c12b283536ee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283536eeb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724186:0:15462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8600/0x998c12b283536ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283536eeb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724198:0:15462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788832256.724206:0:13191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832256.724210:0:13191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8600/0x998c12b283536ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283536eeb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724217:0:13191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c36db8600 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832256.724219:0:13191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8600/0x998c12b283536ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283536eeb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724226:0:13191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8600/0x998c12b283536ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x998c12b283536eeb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832256.724232:0:13191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8600/0x998c12b283536ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x998c12b283536eeb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832256.724237:0:13191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788832256.724239:0:13191:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788832256.724240:0:13191:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788832256.724256:0:13191:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8600/0x998c12b283536ee4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283536eeb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724262:0:13191:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832256.724286:0:13191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8600/0x998c12b283536ee4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283536eeb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724291:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c36db8600/0x998c12b283536ee4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283536eeb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724309:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832256.724311:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832256.724312:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832256.724322:0:15462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b283537280 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537287 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724329:0:15462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b283537280 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283537287 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724335:0:15462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b283537280 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283537287 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724340:0:15462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b283537280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283537287 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724353:0:15462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788832256.724359:0:15462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c4204b600/0x998c12b283536bcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536bd4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724364:0:15462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c4204b600/0x998c12b283536bcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536bd4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724370:0:15462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c4204b600/0x998c12b283536bcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283536bd4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724391:0:15462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9d2c4204b600/0x998c12b283536bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283536bd4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724402:0:15462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788832256.724412:0:15462:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1788832256.724415:0:15462:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:3.0:1788832256.724438:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788832256.724442:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b283537280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283537287 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724448:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0da00 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832256.724450:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b283537280 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283537287 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724457:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b283537280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x998c12b283537287 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832256.724462:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b283537280 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x998c12b283537287 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832256.724467:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788832256.724469:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788832256.724471:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788832256.724484:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b283537280 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283537287 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724491:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832256.724497:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b283537280 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283537287 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724503:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b283537280 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283537287 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724513:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832256.724516:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c4204b600/0x998c12b283536bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283536bd4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724532:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c4204b600 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832256.724536:0:6513:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c4204b600/0x998c12b283536bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283536bd4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724542:0:6513:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c4204b600/0x998c12b283536bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x998c12b283536bd4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832256.724547:0:6513:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c4204b600/0x998c12b283536bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x998c12b283536bd4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832256.724552:0:6513:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788832256.724555:0:6513:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788832256.724556:0:6513:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788832256.724569:0:6513:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c4204b600/0x998c12b283536bcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283536bd4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724575:0:6513:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832256.724581:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c4204b600/0x998c12b283536bcd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283536bd4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724587:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c4204b600/0x998c12b283536bcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x998c12b283536bd4 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832256.724599:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832256.724600:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832256.724602:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788832256.724617:0:15462:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1788832256.724644:0:15462:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1788832256.724648:0:15462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788832256.724654:0:15462:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788832256.724667:0:15462:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9d2c36d20800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788832256.724673:0:15462:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9d2b064c8800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788832256.724678:0:15462:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9d2c35993370) has exports, disconnecting them 00000020:00080000:3.0:1788832256.724682:0:15462:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9d2c36d20800), last request at 1788832253 00000020:00000080:3.0:1788832256.724688:0:15462:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536eac 00000100:00080000:3.0:1788832256.724704:0:15462:0:(import.c:65:import_set_state_nolock()) ffff9d2c36d22000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788832256.724740:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788832256.724752:0:15462:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d2c36d20800): rc 0 00000020:00000080:3.0:1788832256.724755:0:15462:0:(genops.c:885:class_export_put()) final put ffff9d2c36d20800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1788832256.724765:0:15462:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9d2b064c8800), last request at 1788832253 00000020:00000080:3.0:1788832256.724769:0:15462:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536d86 00000100:00080000:3.0:1788832256.724775:0:15462:0:(import.c:65:import_set_state_nolock()) ffff9d2b064ca000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788832256.724784:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788832256.724791:0:15462:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d2b064c8800): rc 0 00000020:00000080:3.0:1788832256.724793:0:15462:0:(genops.c:885:class_export_put()) final put ffff9d2b064c8800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1788832256.724800:0:15462:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb562014a3ae0 00000100:00080000:3.0:1788832256.724818:0:15462:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788832256.724829:0:15462:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9d2b08576a00 x1875726218455552/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788832264 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832256.724839:0:15462:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:1.0:1788832256.725861:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218459136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788832256.725932:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832256.725990:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218455552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788832256.726022:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788832256.726028:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218459264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788832256.726051:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832256.726085:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218459136 00000100:00100000:1.0:1788832256.726093:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218459136 00000100:00100000:1.0:1788832256.726127:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218459264 00000100:00100000:1.0:1788832256.726131:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218459264 00000100:00100000:1.0:1788832256.726227:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788832256.726234:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08552a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3651:x1875726218459136:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788832256.726241:0:6510:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788832256 with bad export cookie 11064238942459226826 00000100:00100000:1.0:1788832256.726358:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08552a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3651:x1875726218459136:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (425us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788832256.726365:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788832256.726394:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788832256.726399:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3651:x1875726218459264:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788832256.726404:0:6510:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788832256 with bad export cookie 11064238942459226826 00000100:00100000:1.0:1788832256.726442:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3651:x1875726218459264:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (390us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788832256.726448:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788832256.726559:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.126@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788832256.726563:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9d2c391a8800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788832256.726567:0:3651:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788832256.727452:0:15462:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788832256.727460:0:15462:0:(import.c:65:import_set_state_nolock()) ffff9d2c3c7a7000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:0.0:1788832256.731717:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c36d20800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1788832256.731779:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b064c8800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1788832256.731802:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c36d22000 for lustre-MDT0001 00000020:00000080:0.0:1788832256.731806:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2b064ca000 for lustre-MDT0001 00000100:00080000:1.0:1788832256.760077:0:3651:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.126@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788832256.760082:0:3651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788832256.760090:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d2c3fc06680 x1875726218457472/t0(0) o400->MGC192.168.203.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788832269 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832256.760107:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d2b07f34380 x1875726218458880/t0(0) o103->MGC192.168.203.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788832272 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832256.760116:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d2c3fd0ed80 x1875726218459136/t0(0) o103->MGC192.168.203.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788832272 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832256.760126:0:3651:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d2c3fd0ea00 x1875726218459264/t0(0) o103->MGC192.168.203.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788832272 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832256.760297:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e55f0905-9d39-4464-9830-326b420fb582:0:1875726218459008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832256.760403:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:0:1875726218459392:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788832256.760866:0:15462:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788832256.760871:0:15462:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1788832256.760896:0:15462:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788832256.760973:0:15462:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788832256.761007:0:15462:0:(import.c:65:import_set_state_nolock()) ffff9d2c36c4d800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788832256.761024:0:15462:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788832256.761026:0:15462:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1788832256.761034:0:15462:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788832256.761108:0:15462:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788832256.761114:0:15462:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e9eb000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788832256.761136:0:15462:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9d2c35993370) has no exports 10000000:01000000:1.0:1788832256.762738:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788832256.762745:0:3651:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788832256.762747:0:3651:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788832256.762752:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9d2c391a8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788832256.762759:0:3651:0:(import.c:510:import_select_connection()) MGC192.168.203.126@tcp: connect to NID 0@lo last attempt 143 00000100:00080000:1.0:1788832256.762769:0:3651:0:(import.c:624:import_select_connection()) MGC192.168.203.126@tcp: import ffff9d2c391a8800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788832256.762938:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b08553480 x1875726218459776/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788832256.763110:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218459136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788832256.763141:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e55f0905-9d39-4464-9830-326b420fb582:3651:1875726218459264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832256.764891:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218459520:0@lo:9:umount.0 00000100:00100000:2.0:1788832256.764964:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832256.765016:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218459648:0@lo:9:umount.0 00000100:00100000:2.0:1788832256.765040:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832256.765065:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e55f0905-9d39-4464-9830-326b420fb582:3650:1875726218459776:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1788832256.765084:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875726218459776 offset 0 length 520: 4 00000100:00100000:2.0:1788832256.765120:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218459520 00000100:00100000:2.0:1788832256.765128:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218459520 00000100:00100000:2.0:1788832256.765178:0:10097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218459648 00000100:00100000:2.0:1788832256.765182:0:10097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218459648 00000100:00100000:2.0:1788832256.765206:0:10097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788832256.765214:0:10097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875726218459520:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788832256.765242:0:10097:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536dd3 00000100:00080000:2.0:1788832256.765261:0:10097:0:(import.c:65:import_set_state_nolock()) ffff9d2b057d8800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788832256.765301:0:10097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00080000:3.0:1788832256.765428:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788832256.765433:0:6521:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788832256.765443:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832256.765472:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788832256.765484:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875726218459648:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788832256.765501:0:8440:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536f15 00000100:00080000:1.0:1788832256.765519:0:8440:0:(import.c:65:import_set_state_nolock()) ffff9d2b064cb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788832256.765558:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788832256.765601:0:10097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3650:x1875726218459520:12345-0@lo:9:umount.0 Request processed in 385us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832256.765610:0:10097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:3.0:1788832256.765661:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832256.765680:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3650:x1875726218459648:12345-0@lo:9:umount.0 Request processed in 197us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832256.765703:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00010000:2.0:1788832256.766566:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832256.766954:0:10343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c09479850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3653:x1875726218458880:12345-0@lo:103:ldlm_bl.0 Request processed in 46656us (46778us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788832256.766965:0:10343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788832256.767058:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c36c4d800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788832256.767082:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788832256.767085:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788832256.767090:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218459520:0@lo:9:umount.0 00000100:00080000:2.0:1788832256.767107:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e9eb000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788832256.767158:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788832256.767275:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788832256.767280:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218459648:0@lo:9:umount.0 00000100:00100000:2.0:1788832256.767313:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218458880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832256.767323:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e55f0905-9d39-4464-9830-326b420fb582:3653:1875726218457472:0@lo:400:kworker.0 00000020:00080000:1.0:1788832256.775211:0:15462:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9d2c35993370) has no exports 00000020:01000000:0.0:1788832256.826456:0:15462:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d2c07cb3d80 - data ffff9d2c31756a20/ffff9d2c36cbfc00 00000020:01000000:0.0:1788832256.826642:0:15462:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d2c390033c0 - data ffff9d2c31580af8/ffff9d2c3e759400 00000001:00000004:3.0:1788832256.868478:0:15462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1788832256.914902:0:15462:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788832256.914911:0:15462:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1788832256.914919:0:15462:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788832256.916299:0:15462:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788832256.916305:0:15462:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1788832256.916321:0:15462:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788832256.916323:0:15462:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788832256.916827:0:8914:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788832256.916832:0:8914:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1788832256.916843:0:8914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788832256.917959:0:15462:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788832256.917964:0:15462:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1788832256.917991:0:15462:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788832256.917993:0:15462:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788832256.918325:0:10086:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788832256.918329:0:10086:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1788832256.918337:0:10086:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788832256.919480:0:15462:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536bf0 00000020:00000080:2.0:1788832256.919491:0:15462:0:(genops.c:885:class_export_put()) final put ffff9d2c35b89000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788832256.919955:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c35b89000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788832256.927640:0:15462:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536c05 00000020:00000080:3.0:1788832256.927657:0:15462:0:(genops.c:885:class_export_put()) final put ffff9d2c35b8a000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788832256.927669:0:15462:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788832256.927674:0:15462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788832256.927683:0:15462:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788832256.927688:0:15462:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9d2c359919b8) has no exports 00000004:01000000:3.0:1788832256.927865:0:15462:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788832256.927874:0:15462:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536f0e 00000020:00000080:3.0:1788832256.927878:0:15462:0:(genops.c:885:class_export_put()) final put ffff9d2c36d23000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788832256.927882:0:15462:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788832256.927885:0:15462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788832256.927892:0:15462:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788832256.927895:0:15462:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9d2c3e778000) has no exports 00000020:00000080:3.0:1788832256.927911:0:15462:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536f07 00000020:00000080:3.0:1788832256.927914:0:15462:0:(genops.c:885:class_export_put()) final put ffff9d2c3fc6f000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788832256.928790:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c35b8a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1788832256.928802:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c36d23000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788832256.928807:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3fc6f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788832256.929719:0:15462:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788832256.929725:0:15462:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788832256.929731:0:15462:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788832256.929739:0:15462:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788832256.929741:0:15462:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788832256.929833:0:15462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788832256.929846:0:15462:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788832256.929867:0:15462:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536dcc 00000020:00000080:3.0:1788832256.929875:0:15462:0:(genops.c:885:class_export_put()) final put ffff9d2c3e9e9000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788832256.930261:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c3e9eb000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788832256.930278:0:36:0:(genops.c:885:class_export_put()) final put ffff9d2c3fc6d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788832256.930281:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3fc6d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788832256.930287:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788832256.930500:0:15462:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788832256.930505:0:15462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788832256.930512:0:15462:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788832256.930516:0:15462:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9d2b06008000) has no exports 00000020:00000080:3.0:1788832256.930523:0:15462:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536dc5 00000020:00000080:3.0:1788832256.930527:0:15462:0:(genops.c:885:class_export_put()) final put ffff9d2c36c4f800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788832256.930544:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3e9e9000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:3.0:1788832256.931044:0:15462:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788832256.931048:0:15462:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788832256.931052:0:15462:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1788832256.931058:0:15462:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788832256.931061:0:15462:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788832256.931551:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c36c4f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788832256.931674:0:15462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788832256.931683:0:15462:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788832256.931698:0:15462:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788832256.931705:0:15462:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536c28 00000020:00000080:3.0:1788832256.931711:0:15462:0:(genops.c:885:class_export_put()) final put ffff9d2c3e567000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788832256.931780:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c36c4d800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788832256.931787:0:36:0:(genops.c:885:class_export_put()) final put ffff9d2b06002800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788832256.931789:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b06002800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788832256.931794:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788832256.931965:0:15462:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788832256.931977:0:15462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788832256.931983:0:15462:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788832256.931986:0:15462:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9d2c3582cd28) has no exports 00000020:00000080:3.0:1788832256.931992:0:15462:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536c21 00000020:00000080:3.0:1788832256.932005:0:15462:0:(genops.c:885:class_export_put()) final put ffff9d2c36bf9800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788832256.932077:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3e567000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788832256.933383:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c36bf9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788832256.944192:0:15462:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1788832256.944202:0:15462:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788832256.944208:0:15462:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1788832256.944216:0:15462:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788832256.944555:0:15462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788832256.944566:0:15462:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788832256.944607:0:15462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788832256.944611:0:15462:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788832256.944644:0:15462:0:(genops.c:885:class_export_put()) final put ffff9d2c39182000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788832256.944649:0:15462:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c39182000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788832256.944661:0:15462:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788832256.944836:0:15462:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536c0c 00000020:00000080:3.0:1788832256.944844:0:15462:0:(genops.c:885:class_export_put()) final put ffff9d2c35b88800/lustre-MDD0001_UUID 00000020:01000000:3.0:1788832256.944848:0:15462:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788832256.944864:0:15462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788832256.944869:0:15462:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788832256.944873:0:15462:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9d2c35994d28) has no exports 00000020:00000080:3.0:1788832256.944893:0:15462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788832256.944896:0:15462:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1788832256.944900:0:15462:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536c13 00000020:00000080:3.0:1788832256.944904:0:15462:0:(genops.c:885:class_export_put()) final put ffff9d2c35b8a800/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1788832256.944911:0:15462:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d2c39185800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1788832256.944914:0:15462:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d2c39185800 2 00000020:01000004:3.0:1788832256.944917:0:15462:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d2c39185800 from lustre-MDT0001 00000020:00000080:3.0:1788832256.944937:0:15462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788832256.944940:0:15462:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1788832256.944942:0:15462:0:(genops.c:885:class_export_put()) final put ffff9d2c35b8c800/lustre-MDT0001_UUID 00000020:00000080:3.0:1788832256.944944:0:15462:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c35b8c800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1788832256.944950:0:15462:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1788832256.944988:0:15462:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1788832256.944992:0:15462:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1788832256.945004:0:15462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788832256.945007:0:15462:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788832256.945014:0:15462:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9d2c3e571000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788832256.945019:0:15462:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9d2c18e34d28) has exports, disconnecting them 00000020:00080000:3.0:1788832256.945023:0:15462:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9d2c3e571000), last request at 1788832022 00000020:00000080:3.0:1788832256.945027:0:15462:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536c67 00000020:00080000:3.0:1788832256.945041:0:15462:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d2c3e571000): rc 0 00000020:00000080:3.0:1788832256.945044:0:15462:0:(genops.c:885:class_export_put()) final put ffff9d2c3e571000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788832256.945988:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c3c7a7000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788832256.945999:0:36:0:(genops.c:885:class_export_put()) final put ffff9d2c36bfd800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788832256.946001:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c36bfd800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1788832256.946013:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788832256.946144:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c35b88800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1788832256.946149:0:36:0:(genops.c:885:class_export_put()) final put ffff9d2c35b8e000/lustre-MDD0001_UUID 00000020:00000080:0.0:1788832256.946151:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c35b8e000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1788832256.946155:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1788832256.946539:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c35b8a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788832256.946549:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3e571000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788832256.966749:0:15462:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788832256.966760:0:15462:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788832256.966764:0:15462:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788832256.966771:0:15462:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788832256.967123:0:15462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788832256.967132:0:15462:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788832256.967141:0:15462:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d2c39185800 1 00000020:00000080:3.0:1788832256.967147:0:15462:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536ba3 00000020:00000080:3.0:1788832256.967155:0:15462:0:(genops.c:885:class_export_put()) final put ffff9d2c3c7a4800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788832256.967184:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c3e574800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788832256.967192:0:36:0:(genops.c:885:class_export_put()) final put ffff9d2c3e575000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1788832256.967195:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3e575000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1788832256.967206:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:3.0:1788832256.967416:0:15462:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788832256.967421:0:15462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788832256.967427:0:15462:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788832256.967431:0:15462:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9d2c35990000) has no exports 00000020:00000080:0.0:1788832256.970934:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3c7a4800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788832256.993702:0:15462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788832256.993717:0:15462:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788832256.993722:0:15462:0:(genops.c:885:class_export_put()) final put ffff9d2c39180000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788832256.993727:0:15462:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c39180000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788832256.993735:0:15462:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788832256.993892:0:15462:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d2c39182800 00000020:01000000:0.0:1788832256.993924:0:15462:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788832256.993929:0:15462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788832256.993933:0:15462:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788832256.993937:0:15462:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9d2c18ecb370) has no exports 00000100:00100000:3.0:1788832256.994343:0:13811:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9d2b07242200:13811] 4 exiting: rc = 0 00000100:00100000:3.0:1788832256.994845:0:6527:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9d2c028d0200:6527] 2 exiting: rc = 0 00000100:00100000:3.0:1788832256.994926:0:6526:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9d2c028d0a00:6526] 1 exiting: rc = 0 00000100:00100000:2.0:1788832256.995054:0:6525:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9d2c028d0400:6525] 0 exiting: rc = 1 00000100:00100000:0.0:1788832256.995181:0:8742:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9d2b06388000:8742] 3 exiting: rc = 0 00000100:00100000:0.0:1788832256.995238:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995247:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995252:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995257:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995263:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995268:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995275:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995281:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995286:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995292:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995297:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995302:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995308:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995313:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995319:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995324:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995329:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995334:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995338:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995343:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995349:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995354:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995360:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995365:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995380:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995386:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995391:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995396:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995402:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995418:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995423:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995429:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995434:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995439:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995444:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995449:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995455:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995461:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995466:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995471:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995476:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995481:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995487:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995493:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995498:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995504:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995509:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995515:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995521:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995527:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995532:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995538:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995544:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995549:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995555:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995560:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995565:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995571:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995576:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995581:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995587:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995592:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995597:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.995603:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832256.999263:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9d2c405b8c00:6529] 1 exiting: rc = 0 00000100:00100000:3.0:1788832256.999307:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9d2c405b8e00:6528] 0 exiting: rc = 1 00000100:00100000:0.0:1788832256.999396:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999405:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999413:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999419:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999424:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999431:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999437:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999442:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999447:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999453:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999459:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999465:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999470:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999475:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999480:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999485:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999489:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999494:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999499:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999505:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999510:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999515:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999520:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999524:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999529:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999534:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999539:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999544:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999550:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999554:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999560:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999565:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999570:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999575:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999580:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999597:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999602:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999607:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999612:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999617:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999645:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999651:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999656:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999661:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999666:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999672:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999677:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999682:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999687:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999692:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999697:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999701:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999706:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999711:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999716:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999720:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999725:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999731:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999736:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999740:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999746:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999751:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999757:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832256.999762:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.000247:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9d2c34910800:6531] 1 exiting: rc = 0 00000100:00100000:3.0:1788832257.000921:0:7934:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9d2c18f2f000:7934] 2 exiting: rc = 0 00000100:00100000:3.0:1788832257.004409:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9d2c34910000:6530] 0 exiting: rc = 1 00000100:00100000:0.0:1788832257.006059:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006073:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006095:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006113:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006121:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006142:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006149:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006156:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006165:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006171:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006180:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006188:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006198:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006205:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006241:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006250:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006260:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006267:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006275:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006282:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006291:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006300:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006309:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006316:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006325:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006334:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006367:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006390:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006397:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006407:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006418:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006428:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006440:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006447:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006453:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006468:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006473:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006479:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006499:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006508:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006522:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006528:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006535:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006542:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006547:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006553:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006558:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006564:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006571:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006576:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006596:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006603:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006608:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006614:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006639:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006646:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006652:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006657:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006664:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006670:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006675:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006681:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006687:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.006700:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.032924:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9d2c095b9200:6532] 0 exiting: rc = 1 00000100:00100000:3.0:1788832257.033081:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9d2c05582c00:6533] 1 exiting: rc = 0 00000100:00100000:2.0:1788832257.035746:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.035766:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.035771:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.035776:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.035781:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.035785:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.035789:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036098:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036103:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036108:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036113:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036118:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036130:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036135:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036140:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036145:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036150:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036155:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036160:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036165:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036170:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036175:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036180:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036184:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036188:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036193:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036198:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036202:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036207:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036212:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036217:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036221:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036225:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036230:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036235:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036239:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036251:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036256:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036260:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036264:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036269:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036273:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036277:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036281:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036286:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036290:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036295:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036300:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036304:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036309:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036313:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036318:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036322:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036327:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036331:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036336:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036341:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036346:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036356:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036445:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036453:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036458:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036463:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.036468:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788832257.037175:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9d2c05582400:6535] 1 exiting: rc = 0 00000100:00100000:0.0:1788832257.037382:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9d2c05582600:6534] 0 exiting: rc = 1 00000100:00100000:3.0:1788832257.037477:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037484:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037499:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037504:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037509:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037515:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037520:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037525:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037531:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037536:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037540:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037545:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037549:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037554:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037559:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037563:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037568:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037572:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037577:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037581:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037586:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037590:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037595:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037600:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037604:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037609:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.037615:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041248:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041254:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041258:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041263:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041268:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041273:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041277:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041282:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041286:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041291:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041314:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041319:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041324:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041329:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041333:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041338:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041343:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041349:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041353:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041358:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041363:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041367:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041384:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041389:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041393:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041399:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041404:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041408:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041413:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041418:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041423:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041427:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041432:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041437:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041441:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041446:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.041452:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.042257:0:6537:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9d2c09830000:6537] 1 exiting: rc = 0 00000100:00100000:2.0:1788832257.042406:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9d2c28436800:6536] 0 exiting: rc = 1 00000100:00100000:3.0:1788832257.042467:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042474:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042479:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042484:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042489:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042494:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042498:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042503:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042515:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042520:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042525:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042530:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042535:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042540:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042544:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042549:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042553:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042558:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042563:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042568:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042572:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042577:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042581:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042585:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042590:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042594:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042599:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042603:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042608:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042612:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042617:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042697:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042702:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042706:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042711:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042717:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042722:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042726:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042731:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042736:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042740:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042745:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042751:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042761:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042767:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042772:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042777:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042782:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042786:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042791:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042796:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042800:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042805:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042811:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042817:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042822:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042827:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042832:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042837:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042842:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042847:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042852:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042857:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.042861:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832257.044495:0:6538:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9d2c4061cc00:6538] 0 exiting: rc = 1 00000100:00100000:0.0:1788832257.044833:0:6540:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9d2c0983ac00:6540] 2 exiting: rc = 0 00000100:00100000:3.0:1788832257.045462:0:6539:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9d2c0983ba00:6539] 1 exiting: rc = 0 00000100:00100000:3.0:1788832257.045521:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045528:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045534:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045540:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045545:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045550:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045556:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045566:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045571:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045576:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045581:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045586:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045593:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045767:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045776:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045782:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045788:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045794:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045800:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045806:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045810:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045815:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045820:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045842:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045849:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045855:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045861:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045867:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045872:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045877:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045883:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045888:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045893:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045898:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045903:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045908:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045913:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045918:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045923:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045928:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045940:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045945:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045950:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045955:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045960:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045966:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045972:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.045993:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.046006:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.046011:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.046016:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.046022:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.046027:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.046032:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.046039:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.046045:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.046050:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.046056:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.046062:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.046068:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.046073:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.046078:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.046084:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832257.046089:0:15462:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788832257.055814:0:15462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788832257.055827:0:15462:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788832257.055833:0:15462:0:(genops.c:885:class_export_put()) final put ffff9d2c04a88800/MDS_uuid 00000020:00000080:3.0:1788832257.055838:0:15462:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c04a88800/MDS_uuid for MDS 00000020:01000000:3.0:1788832257.055845:0:15462:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788832257.055991:0:15462:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788832257.497785:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832258.518777:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788832258.777241:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) e55f0905-9d39-4464-9830-326b420fb582->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788832258.777249:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) e55f0905-9d39-4464-9830-326b420fb582->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788832258.777252:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788832258.777256:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788832258.777260:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e9ee800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788832258.777268:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 393 00000100:00080000:3.0:1788832258.777274:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788832258.777282:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d2c3e9ee800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788832258.777326:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c3fd0f800 x1875726218459904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788832258.777389:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788832258.777393:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788832258.777395:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d2b057ea800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788832258.777398:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 393 00000100:00080000:3.0:1788832258.777402:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788832258.777406:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d2b057ea800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788832258.777420:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c3fd0f480 x1875726218460160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788832258.777471:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218460032:0@lo:400:kworker.0 00000400:00000100:3.0:1788832258.777522:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875726218460032 offset 0 length 224: 4 00000100:00100000:0.0:1788832258.777694:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1875726218459904:0@lo:38:kworker.0 00000400:00000100:0.0:1788832258.777718:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875726218459904 offset 0 length 520: 4 00000100:00100000:0.0:1788832258.777737:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1875726218460160:0@lo:38:kworker.0 00000400:00000100:0.0:1788832258.777766:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875726218460160 offset 0 length 520: 4 00000100:00100000:0.0:1788832258.777789:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788832258.777797:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218460288:0@lo:400:kworker.0 00000400:00000100:0.0:1788832258.777815:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875726218460288 offset 0 length 224: 4 00010000:00010000:2.0:1788832259.543800:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788832260.292854:0:15664:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788832260.307209:0:15664:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788832260.307263:0:15664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9000/0x998c12b283536fe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536fe7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832260.307278:0:15664:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9000/0x998c12b283536fe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536fe7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832260.307286:0:15664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9000/0x998c12b283536fe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283536fe7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832260.307292:0:15664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9000/0x998c12b283536fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283536fe7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832260.307314:0:15664:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788832260.307320:0:15664:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788832260.307344:0:15664:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788832260.307367:0:15664:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d2c3fd0f800 x1875726218459904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788832278 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832260.307384:0:15664:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788832260.307403:0:15664:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788832260.307410:0:15664:0:(import.c:65:import_set_state_nolock()) ffff9d2c3e9ee800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788832260.307414:0:15664:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788832260.307419:0:15664:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d2c3fd0f800 x1875726218459904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788832278 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832260.307427:0:15664:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788832260.307429:0:15664:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:1.0:1788832260.307479:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1875726218459904:0@lo:38:kworker.0 00000100:00080000:1.0:1788832260.308454:0:15664:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788832260.308464:0:15664:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d2c3fd0fb80 x1875726218460032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832274 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832260.308486:0:15664:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788832260.308491:0:15664:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788832260.308512:0:15664:0:(import.c:65:import_set_state_nolock()) ffff9d2b057d9800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788832260.308546:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1875726218460416:0@lo:39:umount.0 00000400:00000100:1.0:1788832260.308594:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875726218460416 offset 0 length 224: 4 00010000:00010000:2.0:1788832260.308755:0:13191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832260.308765:0:13191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9000/0x998c12b283536fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283536fe7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832260.308790:0:13191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c36db9000 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832260.308795:0:13191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9000/0x998c12b283536fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283536fe7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832260.308804:0:13191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9000/0x998c12b283536fe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x998c12b283536fe7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832260.308812:0:13191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9000/0x998c12b283536fe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x998c12b283536fe7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832260.308818:0:13191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788832260.308820:0:13191:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788832260.308823:0:13191:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788832260.308838:0:13191:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d2c391a8800 00010000:00010000:2.0:1788832260.308841:0:13191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9000/0x998c12b283536fe0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x998c12b283536fe7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832260.308848:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c36db9000/0x998c12b283536fe0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x998c12b283536fe7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832260.308860:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832260.308862:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832260.308864:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832260.309558:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1875726218460032:0@lo:400:kworker.0 00010000:00010000:1.0:1788832260.569782:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832261.591184:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788832261.782867:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e55f0905-9d39-4464-9830-326b420fb582->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788832261.782877:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e55f0905-9d39-4464-9830-326b420fb582->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788832261.782880:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788832261.782883:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788832261.783240:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832261.783262:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218460544:0@lo:400:kworker.0 00000400:00000100:2.0:1788832261.783313:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875726218460544 offset 0 length 224: 4 00010000:00010000:2.0:1788832262.614965:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788832262.874918:0:8434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788832262.874934:0:8434:0:(genops.c:885:class_export_put()) final put ffff9d2b057dd000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788832262.875015:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b057dd000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788832262.875068:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2b057d8800 for lustre-OST0000 00000001:00100000:0.0:1788832262.875520:0:9518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788832262.875524:0:9518:0:(genops.c:885:class_export_put()) final put ffff9d2b064cb000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788832262.875583:0:14992:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b064cb000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788832262.875647:0:14992:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2b064cb800 for lustre-OST0001 00010000:00010000:3.0:1788832263.638995:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788832263.830957:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e55f0905-9d39-4464-9830-326b420fb582->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788832263.830986:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) e55f0905-9d39-4464-9830-326b420fb582->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788832263.830989:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788832263.830992:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788832263.831147:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218460672:0@lo:400:kworker.0 00000400:00000100:3.0:1788832263.831201:0:3653:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875726218460672 offset 0 length 224: 4 00010000:00010000:2.0:1788832264.662851:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832265.687423:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832266.456843:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788832256/real 1788832256] req@ffff9d2b08553480 x1875726218459776/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788832266 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832266.456874:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d2b08553480 x1875726218459776/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788832266 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788832266.456893:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c391a8800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788832266.456989:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788832266.456994:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e55f0905-9d39-4464-9830-326b420fb582:3650:1875726218459776:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1788832266.462735:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) e55f0905-9d39-4464-9830-326b420fb582->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788832266.462746:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788832266.462750:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d2c391a8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788832266.462758:0:36:0:(import.c:510:import_select_connection()) MGC192.168.203.126@tcp: connect to NID 0@lo last attempt 396 00000100:00080000:1.0:1788832266.462764:0:36:0:(import.c:589:import_select_connection()) MGC192.168.203.126@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788832266.462771:0:36:0:(import.c:624:import_select_connection()) MGC192.168.203.126@tcp: import ffff9d2c391a8800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788832266.462810:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b08550380 x1875726218460800/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788832266.462848:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788832266.462852:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788832266.462920:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e55f0905-9d39-4464-9830-326b420fb582:3650:1875726218460800:0@lo:250:kworker.0 00000400:00000100:2.0:1788832266.462984:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875726218460800 offset 0 length 520: 4 00000100:00100000:0.0:1788832266.462993:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218460928:0@lo:400:kworker.0 00000400:00000100:0.0:1788832266.463027:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875726218460928 offset 0 length 224: 4 00010000:00010000:3.0:1788832266.713325:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832267.734781:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832268.760697:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832269.783012:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832270.550881:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788832260/real 1788832260] req@ffff9d2b08551f80 x1875726218460416/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788832270 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832270.550916:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d2b08551f80 x1875726218460416/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788832270 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788832270.550938:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2b057d9800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788832270.550968:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1875726218460416:0@lo:39:umount.0 00000100:00080000:1.0:1788832270.551054:0:15664:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788832270.551060:0:15664:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788832270.551065:0:15664:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788832270.552040:0:15664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc800/0x998c12b283536fee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536ff5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832270.552057:0:15664:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc800/0x998c12b283536fee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536ff5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832270.552064:0:15664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc800/0x998c12b283536fee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283536ff5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832270.552072:0:15664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc800/0x998c12b283536fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283536ff5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832270.552115:0:15664:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788832270.552124:0:15664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3e00/0x998c12b283537272 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283537279 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832270.552132:0:15664:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3e00/0x998c12b283537272 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283537279 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832270.552138:0:15664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3e00/0x998c12b283537272 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283537279 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832270.552144:0:15664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3e00/0x998c12b283537272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283537279 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832270.552165:0:15664:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788832270.552170:0:15664:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788832270.552195:0:15664:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788832270.552200:0:15664:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788832270.552205:0:15664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788832270.552210:0:15664:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788832270.552215:0:15664:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9d2b0600cd28) has no exports 00000020:00080000:1.0:1788832270.552240:0:15664:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9d2b0600cd28) has no exports 00000020:01000000:1.0:1788832270.554096:0:15664:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d2b073f1360 - data ffff9d2c3172ba20/ffff9d2c36cfcc00 00000020:01000000:1.0:1788832270.554228:0:15664:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d2b057bf000 - data ffff9d2c314a6360/ffff9d2c36ec8000 00010000:00010000:3.0:1788832270.554437:0:13191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788832270.554448:0:13191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc800/0x998c12b283536fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283536ff5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832270.554484:0:13191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc800 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832270.554488:0:13191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc800/0x998c12b283536fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283536ff5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832270.554497:0:13191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc800/0x998c12b283536fee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x998c12b283536ff5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832270.554505:0:13191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc800/0x998c12b283536fee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x998c12b283536ff5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832270.554511:0:13191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788832270.554525:0:13191:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788832270.554528:0:13191:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788832270.554546:0:13191:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d2c391a8800 00010000:00010000:3.0:1788832270.554550:0:13191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc800/0x998c12b283536fee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x998c12b283536ff5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832270.554557:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c092dc800/0x998c12b283536fee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x998c12b283536ff5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832270.554823:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832270.554830:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3e00/0x998c12b283537272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283537279 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832270.554849:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d3e00 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832270.554853:0:6514:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3e00/0x998c12b283537272 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283537279 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832270.554859:0:6514:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3e00/0x998c12b283537272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x998c12b283537279 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832270.554865:0:6514:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3e00/0x998c12b283537272 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x998c12b283537279 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832270.554871:0:6514:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788832270.554873:0:6514:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788832270.554875:0:6514:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788832270.554882:0:6514:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d2c391a8800 00010000:00010000:2.0:1788832270.554885:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3e00/0x998c12b283537272 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x998c12b283537279 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832270.554892:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3e00/0x998c12b283537272 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x998c12b283537279 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832270.559380:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832270.559387:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832270.559389:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832270.559479:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832270.559482:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832270.559485:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788832270.588516:0:15664:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788832270.597708:0:15664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536d40 00000020:00000080:0.0:1788832270.597720:0:15664:0:(genops.c:885:class_export_put()) final put ffff9d2b06003000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788832270.597738:0:15664:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d2c3e677800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788832270.597743:0:15664:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d2c3e677800 2 00000020:01000004:0.0:1788832270.597746:0:15664:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d2c3e677800 from lustre-OST0000 00000020:00000080:0.0:1788832270.597768:0:15664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788832270.597779:0:15664:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788832270.597782:0:15664:0:(genops.c:885:class_export_put()) final put ffff9d2b06007000/lustre-OST0000_UUID 00000020:00000080:0.0:1788832270.597785:0:15664:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b06007000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788832270.597792:0:15664:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788832270.597844:0:15664:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788832270.597850:0:15664:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788832270.597853:0:15664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788832270.597858:0:15664:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788832270.597865:0:15664:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9d2b057df000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788832270.597871:0:15664:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9d2c35828000) has exports, disconnecting them 00000020:00080000:0.0:1788832270.597876:0:15664:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9d2b057df000), last request at 1788832041 00000020:00000080:0.0:1788832270.597880:0:15664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536d6a 00000020:00000080:3.0:1788832270.598095:0:14992:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b06003000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:0.0:1788832270.598183:0:15664:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d2b057df000): rc 0 00000020:00000080:0.0:1788832270.598200:0:15664:0:(genops.c:885:class_export_put()) final put ffff9d2b057df000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788832270.599204:0:14992:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b057df000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788832270.599738:0:15664:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788832270.599743:0:15664:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788832270.599748:0:15664:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788832270.599753:0:15664:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788832270.599914:0:15664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788832270.599922:0:15664:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788832270.599936:0:15664:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788832270.599939:0:15664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788832270.599943:0:15664:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788832270.599950:0:15664:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9d2b064ca800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788832270.599956:0:15664:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9d2c3e77b370) has exports, disconnecting them 00000020:00080000:2.0:1788832270.599960:0:15664:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9d2b064ca800), last request at 1788832041 00000020:00000080:2.0:1788832270.599964:0:15664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536d7f 00000020:00080000:2.0:1788832270.599979:0:15664:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d2b064ca800): rc 0 00000020:00000080:2.0:1788832270.599984:0:15664:0:(genops.c:885:class_export_put()) final put ffff9d2b064ca800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788832270.600578:0:14992:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c3e9ee800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788832270.600588:0:14992:0:(genops.c:885:class_export_put()) final put ffff9d2c3e9ec800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788832270.600590:0:14992:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3e9ec800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788832270.600606:0:14992:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788832270.600691:0:14992:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b064ca800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788832270.601685:0:15664:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788832270.601690:0:15664:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788832270.601694:0:15664:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788832270.601699:0:15664:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788832270.601722:0:14992:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2b057d9800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788832270.601908:0:15664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788832270.601917:0:15664:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788832270.601922:0:15664:0:(genops.c:885:class_export_put()) final put ffff9d2b057d8000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788832270.601925:0:15664:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b057d8000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788832270.601930:0:15664:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788832270.601978:0:15664:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d2c3e677800 1 00000020:00000080:3.0:1788832270.601984:0:15664:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536d08 00000020:00000080:3.0:1788832270.601989:0:15664:0:(genops.c:885:class_export_put()) final put ffff9d2c3e672000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788832270.602007:0:15664:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788832270.602015:0:14992:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3e672000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788832270.602023:0:15664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788832270.602028:0:15664:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788832270.602031:0:15664:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9d2c18eccd28) has no exports 00000020:00000080:2.0:1788832270.717084:0:15664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788832270.717098:0:15664:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788832270.717104:0:15664:0:(genops.c:885:class_export_put()) final put ffff9d2c3e675000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788832270.717109:0:15664:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3e675000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788832270.717119:0:15664:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788832270.717235:0:15664:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d2c3e675800 00000020:02000400:2.0:1788832270.717760:0:15664:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788832270.814809:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788832271.576255:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) e55f0905-9d39-4464-9830-326b420fb582->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788832271.576264:0:14992:0:(pinger.c:247:ptlrpc_pinger_process_import()) e55f0905-9d39-4464-9830-326b420fb582->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788832271.576268:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788832271.576291:0:14992:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788832271.576357:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788832271.576375:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218461056:0@lo:400:kworker.0 00000400:00000100:1.0:1788832271.576426:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875726218461056 offset 0 length 224: 4 00010000:00010000:1.0:1788832271.831724:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832272.854909:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832273.892201:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788832274.373888:0:15866:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788832274.383774:0:15866:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788832274.384326:0:15866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536fcb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832274.384341:0:15866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536fcb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832274.384348:0:15866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283536fcb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832274.384356:0:15866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283536fcb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832274.384431:0:15866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788832274.384438:0:15866:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788832274.384467:0:15866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788832274.384480:0:15866:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d2c3fd0f480 x1875726218460160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788832278 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832274.384515:0:15866:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788832274.384522:0:15866:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788832274.384529:0:15866:0:(import.c:65:import_set_state_nolock()) ffff9d2b057ea800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788832274.384533:0:15866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788832274.384551:0:15866:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d2c3fd0f480 x1875726218460160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788832278 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832274.384559:0:15866:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788832274.384562:0:15866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:0.0:1788832274.386303:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1875726218460160:0@lo:38:kworker.0 00000100:00080000:1.0:1788832274.389153:0:15866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788832274.389171:0:15866:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d2c3fd0e680 x1875726218460288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832274 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832274.389197:0:15866:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d2b08552d80 x1875726218460544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832277 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832274.389212:0:15866:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d2b08552680 x1875726218460672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832279 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832274.389232:0:15866:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d2b08551500 x1875726218460928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832282 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832274.389242:0:15866:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d2b08551c00 x1875726218461056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832287 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832274.389249:0:15866:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788832274.389264:0:15866:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788832274.389292:0:15866:0:(import.c:65:import_set_state_nolock()) ffff9d2b073a5000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788832274.389330:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1875726218460544:0@lo:400:kworker.0 00000100:00100000:0.0:1788832274.389372:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1875726218460928:0@lo:400:kworker.0 00000100:00100000:0.0:1788832274.389392:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1875726218461184:0@lo:39:umount.0 00000400:00000100:0.0:1788832274.389442:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875726218461184 offset 0 length 224: 4 00010000:00010000:3.0:1788832274.389617:0:13191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832274.389641:0:13191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283536fcb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832274.389653:0:13191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c390f3c00 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832274.389658:0:13191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283536fcb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832274.389669:0:13191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x998c12b283536fcb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832274.389692:0:13191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x998c12b283536fcb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832274.389698:0:13191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788832274.389700:0:13191:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788832274.389703:0:13191:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788832274.389727:0:13191:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d2c391a8800 00010000:00010000:3.0:1788832274.389730:0:13191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536fc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x998c12b283536fcb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832274.389736:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3c00/0x998c12b283536fc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x998c12b283536fcb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832274.389763:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218460672:0@lo:400:kworker.0 00010000:00010000:3.0:1788832274.389781:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832274.389782:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832274.389784:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832274.391433:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218461056:0@lo:400:kworker.0 00000100:00100000:2.0:1788832274.391448:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218460288:0@lo:400:kworker.0 00010000:00010000:2.0:1788832274.908955:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832275.926785:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788832276.696671:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) e55f0905-9d39-4464-9830-326b420fb582->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788832276.696682:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) e55f0905-9d39-4464-9830-326b420fb582->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788832276.951510:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832277.975300:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832279.000682:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832280.023189:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832281.046892:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832281.558759:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788832266/real 1788832266] req@ffff9d2b08550380 x1875726218460800/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788832281 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832281.558798:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d2b08550380 x1875726218460800/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788832281 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788832281.558820:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c391a8800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788832281.558847:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788832281.558851:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e55f0905-9d39-4464-9830-326b420fb582:3650:1875726218460800:0@lo:250:kworker.0 00000100:00080000:2.0:1788832281.558916:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) e55f0905-9d39-4464-9830-326b420fb582->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788832281.558922:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788832281.558925:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d2c391a8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788832281.558931:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.126@tcp: connect to NID 0@lo last attempt 406 00000100:00080000:2.0:1788832281.558936:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.126@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788832281.558942:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.126@tcp: import ffff9d2c391a8800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788832281.558985:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b07f34380 x1875726218461312/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788832281.559066:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e55f0905-9d39-4464-9830-326b420fb582:3650:1875726218461312:0@lo:250:kworker.0 00000400:00000100:0.0:1788832281.559107:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875726218461312 offset 0 length 520: 4 00010000:00010000:2.0:1788832282.070852:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832283.097599:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832284.119731:0:6514:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832284.630919:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788832274/real 1788832274] req@ffff9d2b08551880 x1875726218461184/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788832284 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832284.630955:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d2b08551880 x1875726218461184/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788832284 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788832284.630973:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2b073a5000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788832284.630995:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1875726218461184:0@lo:39:umount.0 00000100:00080000:1.0:1788832284.631662:0:15866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788832284.631669:0:15866:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788832284.631674:0:15866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788832284.632719:0:15866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536fd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283536fd9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832284.632736:0:15866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536fd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283536fd9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832284.632744:0:15866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536fd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283536fd9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832284.637451:0:15866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b283536fd9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832284.637484:0:15866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788832284.637496:0:15866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c00030a00/0x998c12b283537264 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353726b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832284.637504:0:15866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c00030a00/0x998c12b283537264 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b28353726b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832284.637511:0:15866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c00030a00/0x998c12b283537264 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b28353726b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832284.637518:0:15866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.126@tcp lock: ffff9d2c00030a00/0x998c12b283537264 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x998c12b28353726b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832284.637539:0:15866:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788832284.637543:0:15866:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788832284.637578:0:15866:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788832284.637583:0:15866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788832284.637589:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788832284.637595:0:15866:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788832284.637599:0:15866:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9d2c3e77cd28) has no exports 00000020:00080000:1.0:1788832284.637647:0:15866:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9d2c3e77cd28) has no exports 00010000:00010000:3.0:1788832284.637813:0:13191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788832284.637822:0:13191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283536fd9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832284.637830:0:13191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c390f2200 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832284.637834:0:13191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b283536fd9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832284.637844:0:13191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536fd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x998c12b283536fd9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832284.637861:0:13191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536fd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x998c12b283536fd9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832284.637867:0:13191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788832284.637869:0:13191:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788832284.637871:0:13191:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788832284.637885:0:13191:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d2c391a8800 00010000:00010000:3.0:1788832284.637889:0:13191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536fd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x998c12b283536fd9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832284.637895:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c390f2200/0x998c12b283536fd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x998c12b283536fd9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832284.637909:0:13191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832284.637912:0:13191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c00030a00/0x998c12b283537264 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b28353726b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832284.637918:0:13191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030a00 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832284.637921:0:13191:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c00030a00/0x998c12b283537264 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x998c12b28353726b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832284.637927:0:13191:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c00030a00/0x998c12b283537264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x998c12b28353726b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832284.637933:0:13191:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c00030a00/0x998c12b283537264 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x998c12b28353726b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832284.637938:0:13191:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788832284.637940:0:13191:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788832284.637948:0:13191:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788832284.637954:0:13191:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d2c391a8800 00010000:00010000:3.0:1788832284.637957:0:13191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c00030a00/0x998c12b283537264 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x998c12b28353726b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832284.637963:0:13191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c00030a00/0x998c12b283537264 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x998c12b28353726b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832284.637977:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832284.637979:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832284.637980:0:13191:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832284.640529:0:6513:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788832284.643995:0:15866:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d2b073f1720 - data ffff9d2c316eb870/ffff9d2c3e9c3800 00000020:01000000:1.0:1788832284.644113:0:15866:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9d2b073f1960 - data ffff9d2c317345e8/ffff9d2b07524400 00100000:10000000:1.0:1788832284.650760:0:15866:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788832284.664174:0:15866:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536e66 00000020:00000080:3.0:1788832284.664200:0:15866:0:(genops.c:885:class_export_put()) final put ffff9d2c3fc6d800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788832284.664225:0:15866:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d2c3fcaa000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788832284.664230:0:15866:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d2c3fcaa000 2 00000020:01000004:3.0:1788832284.664233:0:15866:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d2c3fcaa000 from lustre-OST0001 00000020:00000080:3.0:1788832284.664262:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788832284.664274:0:15866:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788832284.664277:0:15866:0:(genops.c:885:class_export_put()) final put ffff9d2c3fc6e800/lustre-OST0001_UUID 00000020:00000080:3.0:1788832284.664280:0:15866:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3fc6e800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788832284.664287:0:15866:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788832284.664408:0:15866:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e55f0905-9d39-4464-9830-326b420fb582->MGS 00010000:00010000:3.0:1788832284.664424:0:15866:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c4204a200/0x998c12b283536bbf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x998c12b283536bc6 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832284.664436:0:15866:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c4204a200/0x998c12b283536bbf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x998c12b283536bc6 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832284.664443:0:15866:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788832284.664446:0:15866:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788832284.664449:0:15866:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788832284.664464:0:15866:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d2c391a8800 00010000:00010000:3.0:1788832284.664478:0:15866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c4204a200/0x998c12b283536bbf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x998c12b283536bc6 expref: -99 pid: 7454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832284.664494:0:15866:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283537034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x998c12b28353703b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832284.664502:0:15866:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283537034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x998c12b28353703b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832284.664507:0:15866:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788832284.664510:0:15866:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788832284.664511:0:15866:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788832284.664521:0:15866:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d2c391a8800 00010000:00010000:3.0:1788832284.664524:0:15866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c390f3800/0x998c12b283537034 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x998c12b28353703b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788832284.664541:0:15866:0:(import.c:65:import_set_state_nolock()) ffff9d2c391a8800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788832284.664545:0:15866:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788832284.664547:0:15866:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788832284.664548:0:15866:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788832284.664553:0:15866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788832284.664564:0:15866:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d2b07f34380 x1875726218461312/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788832301 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788832284.664586:0:15866:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788832284.664589:0:15866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000020:00000080:1.0:1788832284.664884:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3fc6d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1788832284.664938:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e55f0905-9d39-4464-9830-326b420fb582:3650:1875726218461312:0@lo:250:kworker.0 10000000:01000000:3.0:1788832284.665030:0:15866:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788832284.665037:0:15866:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536abc 00000020:00000080:3.0:1788832284.665042:0:15866:0:(genops.c:885:class_export_put()) final put ffff9d2c04a8a800/e55f0905-9d39-4464-9830-326b420fb582 00000020:01000000:3.0:1788832284.665058:0:15866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.126@tcp (flags='') 00000020:00000080:3.0:1788832284.665063:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788832284.665068:0:15866:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.126@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788832284.665072:0:15866:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9d2c18e319b8) has no exports 10000000:01000000:1.0:1788832284.665130:0:6522:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:1.0:1788832284.665202:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c04a8a800/e55f0905-9d39-4464-9830-326b420fb582 for MGC192.168.203.126@tcp 10000000:01000000:3.0:1788832284.665272:0:15866:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.126@tcp: client import never connected 00000100:00080000:3.0:1788832284.665275:0:15866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788832284.665277:0:15866:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788832284.665279:0:15866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788832284.665281:0:15866:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788832284.665324:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788832284.665330:0:15866:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.126@tcp (uuid e55f0905-9d39-4464-9830-326b420fb582) 00000020:01000000:3.0:1788832284.665336:0:15866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788832284.665339:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788832284.665342:0:15866:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788832284.665348:0:15866:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9d2b073a6000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788832284.665352:0:15866:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9d2c358299b8) has exports, disconnecting them 00000020:00080000:3.0:1788832284.665357:0:15866:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9d2b073a6000), last request at 1788832060 00000020:00000080:3.0:1788832284.665361:0:15866:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536e90 00000020:00080000:3.0:1788832284.665371:0:15866:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d2b073a6000): rc 0 00000020:00000080:3.0:1788832284.665374:0:15866:0:(genops.c:885:class_export_put()) final put ffff9d2b073a6000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788832284.666332:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2c391a8800 for MGC192.168.203.126@tcp 00000020:00000080:1.0:1788832284.666344:0:37:0:(genops.c:885:class_export_put()) final put ffff9d2c391ae800/e55f0905-9d39-4464-9830-326b420fb582 00000020:00000080:1.0:1788832284.666346:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c391ae800/e55f0905-9d39-4464-9830-326b420fb582 for MGC192.168.203.126@tcp 00000020:01000000:1.0:1788832284.666353:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.126@tcp (e55f0905-9d39-4464-9830-326b420fb582) 00000020:00000080:0.0:1788832284.666848:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b073a6000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788832284.666896:0:15866:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788832284.666900:0:15866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788832284.666903:0:15866:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788832284.666909:0:15866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788832284.667062:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788832284.667068:0:15866:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788832284.667075:0:15866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788832284.667079:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788832284.667083:0:15866:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788832284.667089:0:15866:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9d2b073a7000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788832284.667094:0:15866:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9d2b073e0000) has exports, disconnecting them 00000020:00080000:0.0:1788832284.667098:0:15866:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9d2b073a7000), last request at 1788832060 00000020:00000080:0.0:1788832284.667101:0:15866:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536ea5 00000020:00080000:0.0:1788832284.667112:0:15866:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d2b073a7000): rc 0 00000020:00000080:0.0:1788832284.667116:0:15866:0:(genops.c:885:class_export_put()) final put ffff9d2b073a7000/lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1788832284.667692:0:15866:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788832284.667697:0:15866:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788832284.667700:0:15866:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788832284.667704:0:15866:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788832284.667894:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2b057ea800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788832284.667903:0:37:0:(genops.c:885:class_export_put()) final put ffff9d2b064cc000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788832284.667905:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b064cc000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788832284.667910:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788832284.667973:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b073a7000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788832284.667978:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9d2b073a5000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1788832284.668792:0:6514:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788832284.716728:0:13191:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788832284.762066:0:6513:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788832284.765737:0:6509:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9d2c39120000:6509] 1 exiting: rc = 0 00000100:00100000:3.0:1788832284.771033:0:6508:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9d2c39121600:6508] 0 exiting: rc = 1 00000100:00100000:1.0:1788832284.771482:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.771843:0:7466:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9d2c358a7400:7466] 3 exiting: rc = 0 00000100:00100000:1.0:1788832284.771972:0:6511:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9d2c28634200:6511] 1 exiting: rc = 0 00000100:00100000:1.0:1788832284.772042:0:10344:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_005: service thread [ffff9d2b075f2e00:10344] 5 exiting: rc = 0 00000100:00100000:1.0:1788832284.772127:0:6510:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9d2c39120e00:6510] 0 exiting: rc = 1 00000100:00100000:3.0:1788832284.777325:0:6512:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9d2c02cf2600:6512] 2 exiting: rc = 0 00000100:00100000:3.0:1788832284.777762:0:10343:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9d2b075f2800:10343] 4 exiting: rc = 0 00000100:00100000:1.0:1788832284.780062:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780073:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780079:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780087:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780097:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780103:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780108:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780130:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780137:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780142:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780147:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780152:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780158:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780172:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780180:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780193:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780199:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780204:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780210:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780217:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780222:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780227:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780232:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780238:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780243:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780248:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780254:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780259:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780264:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780270:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780275:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780281:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780286:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780292:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780297:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780302:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780306:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780311:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780316:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780322:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780327:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780332:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780345:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780350:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780356:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780361:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780366:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780371:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780376:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780382:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780387:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780392:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780397:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780402:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780407:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780411:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780416:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780421:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780425:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780429:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780434:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780438:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780442:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.780447:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788832284.790034:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788832284.790057:0:15866:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1788832284.790063:0:15866:0:(genops.c:885:class_export_put()) final put ffff9d2b073a6800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1788832284.790067:0:15866:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2b073a6800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1788832284.790074:0:15866:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1788832284.790128:0:15866:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d2c3fcaa000 1 00000020:00000080:1.0:1788832284.790134:0:15866:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x998c12b283536e35 00000020:00000080:1.0:1788832284.790140:0:15866:0:(genops.c:885:class_export_put()) final put ffff9d2c36d26000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788832284.790152:0:15866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788832284.790163:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c36d26000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788832284.790173:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788832284.790197:0:15866:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788832284.790202:0:15866:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9d2c18ec99b8) has no exports 00000020:00000080:1.0:1788832284.852109:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788832284.852127:0:15866:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788832284.852133:0:15866:0:(genops.c:885:class_export_put()) final put ffff9d2c3fcad800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788832284.852138:0:15866:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3fcad800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788832284.852144:0:15866:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788832284.853343:0:15866:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d2c3fcaa800 00000020:01000000:1.0:1788832284.853421:0:15866:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788832284.853429:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788832284.853434:0:15866:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788832284.853439:0:15866:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9d2c18ec8000) has no exports 00000020:00000080:1.0:1788832284.853463:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788832284.853472:0:15866:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788832284.853476:0:15866:0:(genops.c:885:class_export_put()) final put ffff9d2c3e718000/OSS_uuid 00000020:00000080:1.0:1788832284.853479:0:15866:0:(genops.c:844:class_export_destroy()) destroying export ffff9d2c3e718000/OSS_uuid for OSS 00000020:01000000:1.0:1788832284.853484:0:15866:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788832284.853691:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9d2c3e6d6000:8440] 0 exiting: rc = 1 00000100:00100000:1.0:1788832284.853854:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9d2c3e421200:8442] 2 exiting: rc = 0 00000100:00100000:0.0:1788832284.854840:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9d2c3e420e00:8441] 1 exiting: rc = 0 00000100:00100000:0.0:1788832284.854899:0:10097:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9d2b016e5e00:10097] 3 exiting: rc = 0 00000100:00100000:2.0:1788832284.856351:0:10099:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9d2b07246800:10099] 4 exiting: rc = 0 00000100:00100000:1.0:1788832284.857924:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858054:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858060:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858066:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858073:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858077:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858082:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858086:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858091:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858096:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858100:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858106:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858110:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858115:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858119:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858141:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858147:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858152:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858157:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858163:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858168:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858173:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858178:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858193:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858199:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858204:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858209:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858214:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858219:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858224:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858229:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858235:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858240:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858245:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858250:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858256:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858261:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.858266:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:3.0:1788832284.858311:0:6521:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788832284.859077:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859082:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859090:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859096:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859102:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859108:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859114:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859119:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859124:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859130:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859135:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859140:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859155:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859160:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859166:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859171:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859176:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859190:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859196:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859202:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859217:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859229:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859235:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859241:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859246:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788832284.859258:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.862997:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9d2c3e420c00:8444] 1 exiting: rc = 0 00000100:00100000:0.0:1788832284.865367:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9d2c07604400:8443] 0 exiting: rc = 1 00000100:00100000:0.0:1788832284.867816:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867824:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867830:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867836:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867841:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867846:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867851:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867857:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867875:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867882:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867888:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867893:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867899:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867904:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867909:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867914:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867919:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867925:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867930:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867946:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867952:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867957:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867962:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867968:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867973:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867978:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867984:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867990:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.867995:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868000:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868005:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868010:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868015:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868021:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868026:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868032:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868038:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868043:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868048:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868054:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868059:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868065:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868070:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868083:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868088:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868093:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868098:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868103:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868109:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868113:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868119:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868124:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868130:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868135:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868140:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868145:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868150:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868155:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868161:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868166:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868171:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868176:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868190:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.868203:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.869162:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9d2c3e99c800:8447] 2 exiting: rc = 0 00000100:00100000:2.0:1788832284.871581:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9d2c3e99c200:8445] 0 exiting: rc = 1 00000100:00100000:2.0:1788832284.872013:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9d2c3e99d800:8446] 1 exiting: rc = 0 00000100:00100000:0.0:1788832284.872229:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872238:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872244:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872250:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872255:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872261:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872267:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872271:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872276:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872282:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872287:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872292:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872298:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872314:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872430:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872438:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872444:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872450:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872467:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872474:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872479:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872484:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872489:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872494:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872500:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872506:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872512:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872518:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872533:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872539:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872544:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872549:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872554:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872559:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872564:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872569:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872573:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872578:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872583:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872589:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872594:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872599:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872640:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872648:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872654:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872660:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872665:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872671:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872685:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872691:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872696:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872702:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872707:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872713:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872718:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872723:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872728:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872734:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872741:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872747:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872751:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872765:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872771:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.872776:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.881418:0:8448:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9d2c3e99cc00:8448] 0 exiting: rc = 1 00000100:00100000:0.0:1788832284.881789:0:8449:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9d2c3e99ce00:8449] 1 exiting: rc = 0 00000100:00100000:3.0:1788832284.886717:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886727:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886732:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886737:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886742:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886747:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886751:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886757:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886762:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886793:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886799:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886804:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886809:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886814:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886819:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886824:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886830:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886835:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886841:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886846:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886851:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886856:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886862:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886867:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886873:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886878:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886883:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886888:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886893:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886898:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886903:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886908:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886913:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886921:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886926:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886942:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886948:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886954:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886959:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886965:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886970:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886974:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886979:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886983:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.886996:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.887001:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.887012:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.887019:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.887024:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.887029:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.887035:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.887040:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.887045:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.887050:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.887055:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.887060:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.887064:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.887069:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.887073:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.887078:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.887083:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.887088:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.887093:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.887098:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788832284.893110:0:8450:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9d2b016e5200:8450] 0 exiting: rc = 1 00000100:00100000:0.0:1788832284.893220:0:8451:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9d2b016e4600:8451] 1 exiting: rc = 0 00000100:00100000:3.0:1788832284.893352:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893361:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893479:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893491:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893497:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893503:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893509:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893514:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893520:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893601:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893607:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893674:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893681:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893687:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893693:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893711:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893717:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893724:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893729:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893736:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893741:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893747:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893752:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893773:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893855:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893863:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893869:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893875:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893882:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893889:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893895:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893900:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893907:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893912:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.893919:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894015:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894023:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894029:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894036:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894042:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894047:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894053:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894059:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894065:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894071:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894076:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894083:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894107:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894114:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894120:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894133:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894139:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894145:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894151:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894157:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894163:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894168:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894174:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894180:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894213:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894221:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894227:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894232:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788832284.894245:0:15866:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788832284.918928:0:15866:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788832304.938504:0:16631:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788832315.074111:0:17230:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788832315.074116:0:17230:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788832315.074118:0:17230:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788832315.074241:0:17230:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d2b07d5b800 00000020:01000004:3.0:1788832315.074257:0:17230:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788832315.074266:0:17230:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788832315.074280:0:17230:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9d2b073e19b8) 00000020:00000080:3.0:1788832315.074294:0:17230:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788832315.174112:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788832315.182191:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788832315.183931:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1788832315.184233:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788832315.188073:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788832315.189331:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788832315.189762:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788832315.190083:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1788832315.190330:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1788832315.190570:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1788832315.190986:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788832315.191222:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788832315.191443:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788832315.191759:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788832315.199429:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788832315.200335:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788832315.200524:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788832315.202022:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788832315.203743:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1788832315.204234:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788832315.204466:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788832315.205310:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788832315.206281:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788832315.206669:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788832315.207840:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788832315.210480:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1788832315.212457:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788832315.212968:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1788832315.213326:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788832315.213570:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1788832315.213887:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788832315.215669:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788832315.216058:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788832315.216414:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1788832315.216649:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788832315.216873:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788832315.217219:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788832315.217445:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788832315.217703:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1788832315.217914:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788832315.218241:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1788832315.218453:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788832315.218666:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788832315.218875:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788832315.219357:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788832315.220359:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788832315.224160:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788832315.225333:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1788832315.225999:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1788832315.226558:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1788832315.229075:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1788832315.230270:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1788832315.230605:0:17230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:0.0:1788832315.231538:0:17230:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788832315.232047:0:17230:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788832315.232055:0:17230:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788832315.232069:0:17230:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x998c12b283538079 00000020:01000004:0.0:1788832315.232076:0:17230:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788832315.232160:0:17230:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788832315.232165:0:17230:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d2b07d5b800 from MGS 00000020:01000004:0.0:1788832315.232168:0:17230:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788832315.232179:0:17230:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9d2b0600cd28) 00000020:00000080:0.0:1788832315.232188:0:17230:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788832315.232244:0:17230:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d2b07d5b800 from MGS, refs=2 00080000:01000000:0.0:1788832315.232250:0:17230:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788832315.232254:0:17230:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x998c12b283538087 00000100:00100000:0.0:1788832315.232345:0:17230:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788832315.232466:0:17230:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788832315.232471:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788832315.234229:0:17230:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788832315.234242:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788832315.235749:0:17230:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788832315.235938:0:17230:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788832315.235943:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788832315.244858:0:17230:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788832315.244876:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788832315.245315:0:17230:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788832315.245322:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788832315.246290:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832315.246294:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832315.246296:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832315.249583:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832315.249589:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832315.249602:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832315.250302:0:17230:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788832315.252659:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788832315.255394:0:17230:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788832315.259042:0:17242:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788832315.259114:0:17230:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788832315.259156:0:17230:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788832315.259829:0:17230:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788832315.260160:0:17230:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788832315.260324:0:17230:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788832315.260330:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788832315.261366:0:17230:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788832315.261376:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788832315.261732:0:17230:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788832315.261738:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788832315.262415:0:17230:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788832315.262447:0:17230:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.126@tcp' 00000020:01000004:0.0:1788832315.262449:0:17230:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788832315.262483:0:17230:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.126@tcp (typ=mgc) 00000020:00000080:0.0:1788832315.262496:0:17230:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.126@tcp (ffff9d2b06008000) 00000020:00000080:0.0:1788832315.262511:0:17230:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788832315.262595:0:17230:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2c09882800@MGC192.168.203.126@tcp: add connection 192.168.203.126@tcp at head 00010000:00010000:0.0:1788832315.262741:0:17230:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.126@tcp-0 is initialized 00000040:01000000:0.0:1788832315.262746:0:17230:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788832315.264642:0:17246:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788832315.269588:0:17247:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788832315.278763:0:17230:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.126@tcp (uuid 7e119a26-e2c8-49b5-8e81-f568246f48a1) 00000020:00000080:3.0:1788832315.278793:0:17230:0:(genops.c:1385:class_connect()) connect: client 7e119a26-e2c8-49b5-8e81-f568246f48a1, cookie 0x998c12b283538095 00000100:00080000:3.0:1788832315.278806:0:17230:0:(import.c:510:import_select_connection()) MGC192.168.203.126@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788832315.278813:0:17230:0:(import.c:624:import_select_connection()) MGC192.168.203.126@tcp: import ffff9d2c09882800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788832315.278845:0:17230:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c3fd0fb80 x1875726218461440/t0(0) o250->MGC192.168.203.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788832315.278874:0:17230:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7e119a26-e2c8-49b5-8e81-f568246f48a1->MGS 00000020:01000004:3.0:1788832315.278897:0:17230:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788832315.278902:0:17230:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788832315.278926:0:17230:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9d2b073e3370) 00000020:00000080:3.0:1788832315.278936:0:17230:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788832315.279228:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7e119a26-e2c8-49b5-8e81-f568246f48a1:3650:1875726218461440:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788832315.279295:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832315.279367:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218461440 00000100:00100000:1.0:1788832315.279374:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218461440 00000100:00100000:1.0:1788832315.279403:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832315.279411:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3650:x1875726218461440:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788832315.279431:0:17243:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7e119a26-e2c8-49b5-8e81-f568246f48a1@0@lo t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:1.0:1788832315.279454:0:17243:0:(genops.c:1385:class_connect()) connect: client 7e119a26-e2c8-49b5-8e81-f568246f48a1, cookie 0x998c12b2835380a3 00000100:00080000:1.0:1788832315.279571:0:17243:0:(import.c:65:import_set_state_nolock()) ffff9d2b06000000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788832315.279643:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+5:3650:x1875726218461440:12345-0@lo:250:mount.lustre.0 Request processed in 231us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832315.279651:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832315.279693:0:3650:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.126@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788832315.279701:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.126@tcp: connect to target with instance 0 00000100:00080000:1.0:1788832315.279708:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788832315.279712:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788832315.279715:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c09882800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788832315.279717:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788832315.279725:0:3650:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788832315.279730:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7e119a26-e2c8-49b5-8e81-f568246f48a1:3650:1875726218461440:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788832315.293197:0:17230:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788832315.293434:0:17230:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788832315.293440:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788832315.295568:0:17230:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788832315.295578:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788832315.301987:0:17230:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788832315.302006:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788832315.305071:0:17230:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788832315.305262:0:17230:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788832315.305269:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788832315.309579:0:17230:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788832315.309597:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788832315.420451:0:17230:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788832315.420677:0:17230:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788832315.420682:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788832315.424481:0:17230:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788832315.424493:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788832315.425441:0:17230:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788832315.425991:0:17230:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788832315.425998:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788832315.426568:0:17230:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788832315.426574:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788832315.427437:0:17230:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788832315.427600:0:17230:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788832315.427606:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788832315.428558:0:17230:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788832315.428918:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788832315.429570:0:17230:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788832315.429985:0:17230:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788832315.429992:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788832315.431250:0:17230:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788832315.431616:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788832315.449212:0:17230:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788832315.449512:0:17230:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788832315.449519:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788832315.451105:0:17230:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788832315.451117:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788832315.452134:0:17230:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788832315.452400:0:17230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788832315.456565:0:17230:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788832315.456604:0:17230:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788832315.456650:0:17230:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788832315.456830:0:17230:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788832315.456861:0:17230:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.126@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788832315.456865:0:17230:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788832315.456866:0:17230:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788832315.456868:0:17230:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832315.456869:0:17230:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788832315.456870:0:17230:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832315.456872:0:17230:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832315.456873:0:17230:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788832315.456875:0:17230:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788832315.456877:0:17230:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832315.456878:0:17230:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788832315.456881:0:17230:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788832315.456882:0:17230:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788832315.456884:0:17230:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788832315.456885:0:17230:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788832315.456886:0:17230:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788832315.456887:0:17230:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788832315.456888:0:17230:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788832315.456889:0:17230:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788832315.456890:0:17230:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788832315.456891:0:17230:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788832315.456892:0:17230:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788832315.456916:0:17230:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788832315.456936:0:17230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218461568:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788832315.457012:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832315.457059:0:17230:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c348a1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832315.457210:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218461568 00000100:00100000:3.0:1788832315.457217:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218461568 00000100:00100000:3.0:1788832315.457261:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788832315.457270:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+5:17230:x1875726218461568:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788832315.457432:0:17245:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788832315.457435:0:17245:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788832315.457438:0:17245:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788832315.462483:0:17267:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788832315.463210:0:17245:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1788832315.468311:0:17268:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788832315.468319:0:17268:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788832315.468323:0:17268:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788832315.468325:0:17268:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788832315.468540:0:17268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788832315.468741:0:17245:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788832315.468751:0:17245:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788832315.470771:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+5:17230:x1875726218461568:12345-0@lo:253:mount.lustre.0 Request processed in 13494us (13751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832315.470785:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788832315.470834:0:17230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218461568:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788832315.470849:0:17230:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788832315.470863:0:17230:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788832315.470864:0:17230:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788832315.470866:0:17230:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788832315.470867:0:17230:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788832315.470868:0:17230:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788832315.470869:0:17230:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788832315.470870:0:17230:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788832315.470872:0:17230:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788832315.470874:0:17230:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788832315.470875:0:17230:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788832315.470894:0:17230:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d2b07d5b800 from lustre-MDT0000 10000000:01000000:2.0:1788832315.470923:0:17230:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788832315.470926:0:17230:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788832315.470932:0:17230:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9d2b06008000 10000000:01000000:3.0:1788832315.470961:0:17230:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788832315.470971:0:17230:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9d2b06008000 from 1 10000000:01000000:3.0:1788832315.470983:0:17230:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788832315.471022:0:17230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2e00/0x998c12b2835380aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832315.471032:0:17230:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2e00/0x998c12b2835380aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832315.471041:0:17230:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2e00/0x998c12b2835380aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832315.471060:0:17230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218461696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788832315.471106:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832315.471145:0:17230:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c088876c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832315.471204:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218461696 00000100:00100000:1.0:1788832315.471216:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218461696 00000100:00100000:1.0:1788832315.471262:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788832315.471271:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+5:17230:x1875726218461696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788832315.471403:0:17244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832315.471418:0:17244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2b07cff400/0x998c12b2835380b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b2835380aa expref: -99 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.471443:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2b07cff400/0x998c12b2835380b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b2835380aa expref: 6 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.471453:0:17244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2b07cff400/0x998c12b2835380b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835380aa expref: 6 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.471462:0:17244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cff400, rc 0) 00000100:00100000:1.0:1788832315.471501:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+6:17230:x1875726218461696:12345-0@lo:101:mount.lustre.0 Request processed in 231us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832315.471507:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788832315.471586:0:17230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218461696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788832315.471600:0:17230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2e00/0x998c12b2835380aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835380b1 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832315.471609:0:17230:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2e00/0x998c12b2835380aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b2835380b1 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832315.473455:0:17230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218461824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788832315.473517:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832315.473560:0:17230:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c088876c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832315.473828:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218461824 00000100:00100000:1.0:1788832315.473834:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218461824 00000100:00100000:1.0:1788832315.473922:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788832315.473930:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04ddb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+6:17230:x1875726218461824:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788832315.474028:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04ddb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+6:17230:x1875726218461824:12345-0@lo:501:mount.lustre.0 Request processed in 98us (511us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788832315.474035:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788832315.474108:0:17230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218461824:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788832315.474140:0:17230:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788832315.474162:0:17230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2e00/0x998c12b2835380aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835380b1 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832315.474173:0:17230:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2e00/0x998c12b2835380aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835380b1 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832315.474182:0:17230:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d2b07d5b800 10000000:01000000:3.0:1788832315.474186:0:17230:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788832315.474190:0:17230:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d2b07d5b800 10000000:01000000:3.0:1788832315.474193:0:17230:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788832315.474196:0:17230:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9d2b07d5b800 from 1 10000000:01000000:3.0:1788832315.474198:0:17230:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788832315.474222:0:17230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b2835380b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832315.474241:0:17230:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b2835380b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832315.474251:0:17230:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b2835380b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832315.474264:0:17230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218461952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788832315.474305:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832315.476576:0:17230:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c088876c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832315.476992:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218461952 00000100:00100000:2.0:1788832315.477001:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218461952 00000100:00100000:2.0:1788832315.477058:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788832315.477070:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+6:17230:x1875726218461952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788832315.477261:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832315.477282:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c01228a00/0x998c12b2835380bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b2835380b8 expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832315.477365:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c01228a00/0x998c12b2835380bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b2835380b8 expref: 7 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832315.477377:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c01228a00/0x998c12b2835380bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835380b8 expref: 7 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832315.477386:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c01228a00, rc 0) 00000100:00100000:2.0:1788832315.477453:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+7:17230:x1875726218461952:12345-0@lo:101:mount.lustre.0 Request processed in 386us (3147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832315.477460:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788832315.477803:0:17230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218461952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788832315.477825:0:17230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b2835380b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835380bf expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832315.477836:0:17230:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b2835380b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b2835380bf expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832315.477855:0:17230:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788832315.477868:0:17230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b2835380b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835380bf expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832315.477884:0:17230:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3600/0x998c12b2835380b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835380bf expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832315.477893:0:17230:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788832315.477898:0:17230:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788832315.477903:0:17230:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d2b07d5b800 10000000:01000000:3.0:1788832315.477905:0:17230:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788832315.477921:0:17230:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788832315.477924:0:17230:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788832315.477949:0:17230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b2835380c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832315.477956:0:17230:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b2835380c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832315.477964:0:17230:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b2835380c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832315.477991:0:17230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218462080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788832315.478030:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832315.478066:0:17230:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c088876c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832315.478221:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218462080 00000100:00100000:1.0:1788832315.478227:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218462080 00000100:00100000:1.0:1788832315.478268:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788832315.478277:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04ddbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+7:17230:x1875726218462080:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788832315.478295:0:17244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832315.478313:0:17244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2b07cfe600/0x998c12b2835380cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b2835380c6 expref: -99 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.478330:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2b07cfe600/0x998c12b2835380cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b2835380c6 expref: 8 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.478339:0:17244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2b07cfe600/0x998c12b2835380cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835380c6 expref: 8 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.478346:0:17244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe600, rc 0) 00000100:00100000:1.0:1788832315.478387:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04ddbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+8:17230:x1875726218462080:12345-0@lo:101:mount.lustre.0 Request processed in 112us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832315.478394:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788832315.478511:0:17230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218462080:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788832315.478522:0:17230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b2835380c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835380cd expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832315.478529:0:17230:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b2835380c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b2835380cd expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832315.478578:0:17230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218462208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788832315.478605:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832315.478659:0:17230:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c088876c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832315.478732:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218462208 00000100:00100000:1.0:1788832315.478736:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218462208 00000100:00100000:1.0:1788832315.478761:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788832315.478767:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04ddb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+8:17230:x1875726218462208:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788832315.478882:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04ddb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+9:17230:x1875726218462208:12345-0@lo:501:mount.lustre.0 Request processed in 115us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832315.478889:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788832315.478967:0:17230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218462208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788832315.479004:0:17230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218462336:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788832315.479043:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832315.479079:0:17230:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c088876c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832315.480688:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218462336 00000100:00100000:1.0:1788832315.480699:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218462336 00000100:00100000:1.0:1788832315.480754:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788832315.480764:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04ddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+9:17230:x1875726218462336:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788832315.483242:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04ddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+9:17230:x1875726218462336:12345-0@lo:503:mount.lustre.0 Request processed in 2471us (4190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832315.483269:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788832315.491183:0:17230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218462336:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788832315.492571:0:17269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f36d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e119a26-e2c8-49b5-8e81-f568246f48a1:17269:1875726218462464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832315.492698:0:17269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832315.492734:0:17269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3901c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788832315.493390:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218462464 00000100:00100000:1.0:1788832315.493398:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218462464 00000100:00100000:1.0:1788832315.493455:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788832315.493464:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+9:17269:x1875726218462464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788832315.495319:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+9:17269:x1875726218462464:12345-0@lo:502:llog_process_th.0 Request processed in 1849us (2613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832315.495333:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788832315.497140:0:17269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f36d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e119a26-e2c8-49b5-8e81-f568246f48a1:17269:1875726218462464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832315.497189:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832315.497203:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832315.497205:0:17269:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788832315.497210:0:17269:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788832315.497213:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788832315.497227:0:17269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9d2c3e7799b8) 00000020:00000080:2.0:1788832315.497246:0:17269:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788832315.497250:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788832315.497344:0:17269:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788832315.497354:0:17269:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x998c12b2835380db 00000020:00000080:2.0:1788832315.497559:0:17269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788832315.497570:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832315.497573:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832315.497575:0:17269:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788832315.497578:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832315.497581:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832315.497582:0:17269:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788832315.497585:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788832315.497592:0:17269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9d2c3e77cd28) 00000020:00000080:2.0:1788832315.497603:0:17269:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788832315.497607:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788832315.497608:0:17269:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788832315.497610:0:17269:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788832315.497617:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788832315.497678:0:17269:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d2b07d5b800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788832315.497691:0:17269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9d2c3e77b370) 00000020:00000080:2.0:1788832315.497699:0:17269:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788832315.497746:0:17269:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788832315.497758:0:17269:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x998c12b2835380f0 00000020:00000080:2.0:1788832315.497843:0:17269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788832315.497849:0:17269:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788832315.497854:0:17269:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x998c12b2835380f7 00080000:01000000:2.0:1788832315.497859:0:17269:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788832315.497862:0:17269:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x998c12b2835380fe 00010000:00010000:2.0:1788832315.632380:0:17269:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788832315.635972:0:17269:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:2.0:1788832315.636310:0:17269:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788832315.640126:0:17269:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9d2c3e778000) 00000020:00000080:2.0:1788832315.640146:0:17269:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788832315.640239:0:17269:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788832315.640246:0:17269:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x998c12b28353810c 00000020:00000080:3.0:1788832315.641267:0:17269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788832315.653134:0:17269:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x998c12b283538113 00000020:00000080:3.0:1788832315.656536:0:17269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788832315.656550:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832315.656557:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832315.656559:0:17269:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788832315.656563:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788832315.656566:0:17269:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788832315.656568:0:17269:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788832315.656569:0:17269:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788832315.656579:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788832315.656583:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832315.656584:0:17269:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788832315.656587:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832315.656591:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832315.656592:0:17269:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788832315.656596:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788832315.656667:0:17269:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788832315.656688:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832315.656692:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832315.656693:0:17269:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788832315.656695:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832315.656698:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832315.656700:0:17269:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788832315.656702:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788832315.656707:0:17269:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:00000080:3.0:1788832315.656733:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788832315.656748:0:17269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9d2b073e4d28) 00000020:00000080:3.0:1788832315.656765:0:17269:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788832315.656769:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788832315.656842:0:17269:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788832315.656848:0:17269:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788832315.656855:0:17269:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x998c12b283538121 00010000:00080000:3.0:1788832315.656886:0:17269:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2c3fd38800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.126@tcp at head 00010000:00010000:3.0:1788832315.665052:0:17269:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788832315.666401:0:17269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788832315.666427:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788832315.666467:0:17269:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788832315.666488:0:17269:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x998c12b283538128 00000100:00080000:1.0:1788832315.666499:0:17269:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788832315.666505:0:17269:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d2c3fd38800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788832315.666540:0:17269:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b08551180 x1875726218462592/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788832315.666567:0:17269:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788832315.666682:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832315.666696:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832315.666698:0:17269:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788832315.666702:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788832315.666705:0:17269:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1788832315.666707:0:17269:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788832315.666708:0:17269:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788832315.666709:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788832315.666712:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832315.666713:0:17269:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788832315.666716:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788832315.666720:0:17269:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788832315.666728:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832315.666730:0:17269:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788832315.666734:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788832315.666737:0:17269:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:1.0:1788832315.666890:0:17269:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788832315.666894:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788832315.666906:0:17269:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9d2c3fd1b370) 00000020:00000080:1.0:1788832315.666918:0:17269:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788832315.666922:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788832315.666992:0:17269:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788832315.666999:0:17269:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788832315.667006:0:17269:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x998c12b283538136 00010000:00080000:1.0:1788832315.667036:0:17269:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2c3d6f6000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.126@tcp at head 00010000:00010000:1.0:1788832315.667240:0:17269:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1788832315.667668:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218462592:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788832315.667765:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832315.668213:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218462592 00000100:00100000:1.0:1788832315.668222:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218462592 00000100:00100000:1.0:1788832315.668254:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832315.668262:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1875726218462592:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1788832315.668277:0:17256:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:2.0:1788832315.695297:0:17269:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788832315.695651:0:17269:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788832315.696421:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1875726218462592:12345-0@lo:38:llog_process_th.0 Request processed in 28141us (28650us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788832315.696434:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788832315.696641:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3fd38800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788832315.696647:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788832315.696652:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218462592:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788832315.698363:0:17269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788832315.700546:0:17269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788832315.708855:0:17269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788832315.723859:0:17275:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788832315.723870:0:17275:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788832315.728365:0:17269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788832315.728382:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788832315.728429:0:17269:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788832315.728449:0:17269:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x998c12b28353813d 00000100:00080000:2.0:1788832315.728460:0:17269:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788832315.728467:0:17269:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d2c3d6f6000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788832315.728504:0:17269:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b07f34000 x1875726218462720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788832315.728530:0:17269:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788832315.728645:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832315.728650:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832315.728652:0:17269:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788832315.728656:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788832315.728659:0:17269:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1788832315.728660:0:17269:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788832315.728662:0:17269:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788832315.728663:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788832315.728665:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832315.728666:0:17269:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788832315.728669:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788832315.728673:0:17269:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788832315.728676:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832315.728677:0:17269:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788832315.728680:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788832315.728683:0:17269:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:2.0:1788832315.728705:0:17269:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788832315.728708:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788832315.728719:0:17269:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9d2c358299b8) 00000020:00000080:2.0:1788832315.728731:0:17269:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788832315.728735:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788832315.728792:0:17269:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788832315.728799:0:17269:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788832315.728805:0:17269:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x998c12b28353814b 00010000:00080000:2.0:1788832315.728833:0:17269:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2c0aef0000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.126@tcp at head 00000100:00100000:1.0:1788832315.728929:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218462720:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788832315.728994:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875726218462720 offset 0 length 520: 4 00010000:00010000:2.0:1788832315.729080:0:17269:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788832315.729155:0:17269:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788832315.729169:0:17269:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788832315.737719:0:17269:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788832315.738369:0:17269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788832315.738491:0:17269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788832315.739429:0:17277:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788832315.739434:0:17277:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788832315.740355:0:17269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788832315.740368:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788832315.740471:0:17269:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788832315.740494:0:17269:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x998c12b283538152 00000100:00080000:2.0:1788832315.740511:0:17269:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788832315.740516:0:17269:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d2c0aef0000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788832315.740553:0:17269:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b07f35500 x1875726218462848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788832315.740635:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218462848:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788832315.740696:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875726218462848 offset 0 length 520: 4 00000100:00080000:2.0:1788832315.740778:0:17269:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788832315.740894:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832315.740899:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832315.740900:0:17269:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788832315.740903:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832315.740907:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832315.740909:0:17269:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788832315.740911:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788832315.740913:0:17269:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788832315.740914:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832315.740916:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832315.740918:0:17269:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788832315.740920:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832315.740922:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832315.740924:0:17269:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788832315.740927:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788832315.740957:0:17269:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e119a26-e2c8-49b5-8e81-f568246f48a1:17269:1875726218462976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832315.741016:0:17269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832315.741049:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218462976 00000100:00100000:2.0:1788832315.741055:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218462976 00000100:00100000:2.0:1788832315.741093:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788832315.741101:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+9:17269:x1875726218462976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832315.741208:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+9:17269:x1875726218462976:12345-0@lo:502:llog_process_th.0 Request processed in 107us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832315.741216:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788832315.741263:0:17269:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0305c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832315.741279:0:17269:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e119a26-e2c8-49b5-8e81-f568246f48a1:17269:1875726218462976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832315.741303:0:17269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832315.741308:0:17269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832315.741309:0:17269:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788832315.741313:0:17269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788832315.745917:0:17230:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788832315.745987:0:17230:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788832315.746063:0:17230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b2835380c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835380cd expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832315.746075:0:17230:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c421d3400/0x998c12b2835380c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835380cd expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832315.746083:0:17230:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d2b07d5b800 from 1 10000000:01000000:0.0:1788832315.746086:0:17230:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788832315.746133:0:17230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b283538159 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832315.746141:0:17230:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b283538159 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832315.746152:0:17230:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b283538159 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832315.746176:0:17230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218463104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788832315.746242:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832315.746289:0:17230:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376540 going to sleep for 11 seconds 00000100:00100000:3.0:1788832315.746875:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218463104 00000100:00100000:3.0:1788832315.746883:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218463104 00000100:00100000:3.0:1788832315.746935:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788832315.746944:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+9:17230:x1875726218463104:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788832315.746959:0:17244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832315.746984:0:17244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c421d2a00/0x998c12b283538160 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283538159 expref: -99 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832315.747007:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d2a00/0x998c12b283538160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283538159 expref: 10 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832315.747017:0:17244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c421d2a00/0x998c12b283538160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283538159 expref: 10 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832315.747026:0:17244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2a00, rc 0) 00000100:00100000:3.0:1788832315.747068:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+10:17230:x1875726218463104:12345-0@lo:101:mount.lustre.0 Request processed in 125us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832315.747075:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788832315.747548:0:17230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218463104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788832315.747564:0:17230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b283538159 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538160 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832315.747586:0:17230:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b283538159 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283538160 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832315.751159:0:17230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218463232:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788832315.751243:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832315.751363:0:17230:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376540 going to sleep for 11 seconds 00000100:00100000:3.0:1788832315.755219:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218463232 00000100:00100000:3.0:1788832315.755234:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218463232 00000100:00100000:3.0:1788832315.755345:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788832315.755358:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+10:17230:x1875726218463232:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788832315.755384:0:17243:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788832315.755390:0:17243:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788832315.755541:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+10:17230:x1875726218463232:12345-0@lo:256:mount.lustre.0 Request processed in 186us (4298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832315.755549:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788832315.755663:0:17230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218463232:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788832315.756281:0:17230:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788832315.756301:0:17230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b283538159 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538160 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832315.756311:0:17230:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b283538159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538160 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832315.756319:0:17230:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2b07d5b800 from 1 10000000:01000000:0.0:1788832315.756322:0:17230:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788832315.756356:0:17230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c600/0x998c12b283538167 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832315.756364:0:17230:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c600/0x998c12b283538167 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832315.756372:0:17230:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c600/0x998c12b283538167 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832315.756391:0:17230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218463360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788832315.756435:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832315.758313:0:17230:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376540 going to sleep for 11 seconds 00000100:00100000:1.0:1788832315.758385:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218463360 00000100:00100000:1.0:1788832315.758394:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218463360 00000100:00100000:1.0:1788832315.758454:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788832315.758464:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+10:17230:x1875726218463360:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788832315.758479:0:17244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832315.758498:0:17244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2b07cfec00/0x998c12b28353816e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283538167 expref: -99 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.758524:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2b07cfec00/0x998c12b28353816e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283538167 expref: 11 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.758535:0:17244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2b07cfec00/0x998c12b28353816e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283538167 expref: 11 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.758544:0:17244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfec00, rc 0) 00000100:00100000:1.0:1788832315.758605:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+11:17230:x1875726218463360:12345-0@lo:101:mount.lustre.0 Request processed in 143us (2170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832315.758614:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788832315.758792:0:17230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218463360:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788832315.758808:0:17230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c600/0x998c12b283538167 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353816e expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832315.758817:0:17230:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c600/0x998c12b283538167 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b28353816e expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832315.758884:0:17230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218463488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788832315.758917:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832315.758927:0:17230:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376540 going to sleep for 11 seconds 00000100:00100000:1.0:1788832315.759081:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218463488 00000100:00100000:1.0:1788832315.759086:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218463488 00000100:00100000:1.0:1788832315.759105:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788832315.759111:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+11:17230:x1875726218463488:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788832315.762096:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+11:17230:x1875726218463488:12345-0@lo:501:mount.lustre.0 Request processed in 2976us (3169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832315.762110:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788832315.762329:0:17230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218463488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788832315.762388:0:17230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218463616:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788832315.762531:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832315.763005:0:17230:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376540 going to sleep for 11 seconds 00000100:00100000:3.0:1788832315.763058:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218463616 00000100:00100000:3.0:1788832315.763065:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218463616 00000100:00100000:3.0:1788832315.763124:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788832315.763134:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+11:17230:x1875726218463616:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788832315.763281:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+11:17230:x1875726218463616:12345-0@lo:503:mount.lustre.0 Request processed in 148us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832315.763288:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788832315.763378:0:17230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218463616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788832315.766685:0:17279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e119a26-e2c8-49b5-8e81-f568246f48a1:17279:1875726218463744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832315.766773:0:17279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832315.766820:0:17279:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0305c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832315.766884:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218463744 00000100:00100000:3.0:1788832315.766892:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218463744 00000100:00100000:3.0:1788832315.766942:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788832315.766952:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+11:17279:x1875726218463744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832315.767962:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+11:17279:x1875726218463744:12345-0@lo:502:llog_process_th.0 Request processed in 1007us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832315.767980:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788832315.768140:0:17279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e119a26-e2c8-49b5-8e81-f568246f48a1:17279:1875726218463744:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788832315.768175:0:17279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832315.768185:0:17279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832315.768188:0:17279:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788832315.768196:0:17279:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d2b07d5b800 00000020:00000080:2.0:1788832315.768199:0:17279:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788832315.768208:0:17279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832315.768210:0:17279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832315.768211:0:17279:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788832315.768214:0:17279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832315.768216:0:17279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832315.768217:0:17279:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788832315.768221:0:17279:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d2b07d5b800 00000020:00000080:2.0:1788832315.768223:0:17279:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788832315.768283:0:17279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832315.768287:0:17279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832315.768288:0:17279:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788832315.768291:0:17279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832315.768294:0:17279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832315.768295:0:17279:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788832315.768308:0:17279:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d2b07d5b800 00000020:00000080:2.0:1788832315.768310:0:17279:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788832315.768330:0:17279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832315.768333:0:17279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832315.768334:0:17279:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788832315.768337:0:17279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832315.768339:0:17279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832315.768340:0:17279:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788832315.768344:0:17279:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d2b07d5b800 00000020:00000080:2.0:1788832315.768346:0:17279:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788832315.768390:0:17279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e119a26-e2c8-49b5-8e81-f568246f48a1:17279:1875726218463872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788832315.768434:0:17279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832315.768469:0:17279:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0305c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832315.768613:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218463872 00000100:00100000:0.0:1788832315.768647:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218463872 00000100:00100000:0.0:1788832315.768695:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788832315.768704:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+11:17279:x1875726218463872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832315.768812:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+11:17279:x1875726218463872:12345-0@lo:502:llog_process_th.0 Request processed in 108us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832315.768819:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788832315.770001:0:17279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e119a26-e2c8-49b5-8e81-f568246f48a1:17279:1875726218463872:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788832315.770038:0:17279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832315.770045:0:17279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832315.770047:0:17279:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788832315.770051:0:17279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788832315.770221:0:17230:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788832315.770242:0:17230:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788832315.770266:0:17230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c600/0x998c12b283538167 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353816e expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832315.770290:0:17230:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c600/0x998c12b283538167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353816e expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832315.770337:0:17230:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788832315.770341:0:17230:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d2b07d5b800 10000000:01000000:0.0:1788832315.770344:0:17230:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d2b07d5b800 10000000:01000000:0.0:1788832315.770348:0:17230:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788832315.770353:0:17230:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d2b07d5b800 from 1 10000000:01000000:0.0:1788832315.770355:0:17230:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788832315.770385:0:17230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d600/0x998c12b283538175 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832315.770392:0:17230:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d600/0x998c12b283538175 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832315.770402:0:17230:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d600/0x998c12b283538175 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832315.770422:0:17230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218464000:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788832315.770471:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832315.770511:0:17230:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b063760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832315.770787:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218464000 00000100:00100000:2.0:1788832315.770794:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218464000 00000100:00100000:2.0:1788832315.770829:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788832315.770837:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+11:17230:x1875726218464000:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788832315.770850:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832315.770862:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c01228600/0x998c12b28353817c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283538175 expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832315.770895:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c01228600/0x998c12b28353817c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283538175 expref: 12 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832315.770906:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c01228600/0x998c12b28353817c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283538175 expref: 12 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832315.770915:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c01228600, rc 0) 00000100:00100000:2.0:1788832315.770950:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:17230:x1875726218464000:12345-0@lo:101:mount.lustre.0 Request processed in 114us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832315.770967:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788832315.772670:0:17230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218464000:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788832315.772697:0:17230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d600/0x998c12b283538175 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353817c expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832315.772710:0:17230:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d600/0x998c12b283538175 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b28353817c expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832315.772801:0:17230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218464128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788832315.772855:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832315.772898:0:17230:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b063760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832315.773896:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218464128 00000100:00100000:2.0:1788832315.773904:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218464128 00000100:00100000:2.0:1788832315.773951:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788832315.773961:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:17230:x1875726218464128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788832315.774117:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:17230:x1875726218464128:12345-0@lo:501:mount.lustre.0 Request processed in 158us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832315.774125:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788832315.774921:0:17230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218464128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788832315.774971:0:17230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218464256:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788832315.775035:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832315.775063:0:17230:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b063760c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832315.775081:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218464256 00000100:00100000:0.0:1788832315.775085:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218464256 00000100:00100000:0.0:1788832315.775115:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788832315.775121:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:17230:x1875726218464256:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788832315.775210:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:17230:x1875726218464256:12345-0@lo:503:mount.lustre.0 Request processed in 87us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832315.775218:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788832315.775260:0:17230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218464256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788832315.783716:0:17281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e119a26-e2c8-49b5-8e81-f568246f48a1:17281:1875726218464384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832315.783794:0:17281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832315.783838:0:17281:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c11fcad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788832315.784119:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218464384 00000100:00100000:1.0:1788832315.784126:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218464384 00000100:00100000:1.0:1788832315.784176:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788832315.784185:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:17281:x1875726218464384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788832315.784302:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:17281:x1875726218464384:12345-0@lo:502:llog_process_th.0 Request processed in 117us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832315.784310:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788832315.785565:0:17281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e119a26-e2c8-49b5-8e81-f568246f48a1:17281:1875726218464384:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788832315.785681:0:17281:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788832315.785697:0:17281:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9d2b073e0000) 00000020:00000080:3.0:1788832315.785716:0:17281:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788832315.785826:0:17281:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d2b07d5b800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788832315.785830:0:17281:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d2b07d5b800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788832315.785833:0:17281:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d2b07d5b800 4 00010000:00080000:3.0:1788832315.785860:0:17281:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2c1fe58800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.126@tcp at head 00010000:00010000:3.0:1788832315.790958:0:17281:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788832315.791160:0:17281:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788832315.791202:0:17281:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788832315.791214:0:17281:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x998c12b28353818a 00000100:00080000:3.0:1788832315.791223:0:17281:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788832315.791230:0:17281:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9d2c1fe58800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788832315.791266:0:17281:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c3fd0dc00 x1875726218464512/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788832315.791307:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875726218464512:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788832315.791374:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832315.791453:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218464512 00000100:00100000:3.0:1788832315.791460:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218464512 00000100:00080000:2.0:1788832315.794683:0:17281:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788832315.795322:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788832315.795334:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1875726218464512:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788832315.795435:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1875726218464512:12345-0@lo:38:llog_process_th.0 Request processed in 101us (4060us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788832315.795454:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788832315.797278:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788832315.797289:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c1fe58800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788832315.797294:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788832315.797298:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875726218464512:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788832315.811422:0:17281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e119a26-e2c8-49b5-8e81-f568246f48a1:17281:1875726218464640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832315.811566:0:17281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832315.811665:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218464640 00000100:00100000:3.0:1788832315.811692:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218464640 00000100:00100000:3.0:1788832315.811760:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788832315.811770:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:17281:x1875726218464640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832315.812216:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:17281:x1875726218464640:12345-0@lo:502:llog_process_th.0 Request processed in 444us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832315.812227:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788832315.812311:0:17281:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c11fca000 going to sleep for 11 seconds 00000100:00100000:3.0:1788832315.812342:0:17281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e119a26-e2c8-49b5-8e81-f568246f48a1:17281:1875726218464640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832315.812409:0:17281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e119a26-e2c8-49b5-8e81-f568246f48a1:17281:1875726218464768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788832315.812454:0:17281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832315.812656:0:17281:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c11fca000 going to sleep for 11 seconds 00000100:00100000:0.0:1788832315.812856:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218464768 00000100:00100000:0.0:1788832315.812868:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218464768 00000100:00100000:0.0:1788832315.813049:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788832315.813059:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:17281:x1875726218464768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788832315.813224:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:17281:x1875726218464768:12345-0@lo:502:llog_process_th.0 Request processed in 166us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832315.813231:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788832315.814772:0:17281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e119a26-e2c8-49b5-8e81-f568246f48a1:17281:1875726218464768:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788832315.814819:0:17281:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788832315.816806:0:17230:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788832315.816865:0:17230:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788832315.817136:0:17230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d600/0x998c12b283538175 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353817c expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832315.817149:0:17230:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d600/0x998c12b283538175 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353817c expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788832315.817214:0:17230:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788832315.817216:0:17230:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788832315.817217:0:17230:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832315.817219:0:17230:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832315.817220:0:17230:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832315.817222:0:17230:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832315.817223:0:17230:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788832315.817224:0:17230:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788832315.817226:0:17230:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832315.817227:0:17230:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788832315.817231:0:17230:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788832315.817233:0:17230:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788832315.817235:0:17230:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788832315.817236:0:17230:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832315.817237:0:17230:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832315.817239:0:17230:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832315.817240:0:17230:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832315.817241:0:17230:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788832315.817242:0:17230:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788832315.817243:0:17230:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832315.817244:0:17230:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788832315.817270:0:17230:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788832315.817291:0:17230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218464896:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788832315.817360:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832315.817404:0:17230:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06376b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788832315.822203:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218464896 00000100:00100000:1.0:1788832315.822217:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218464896 00000100:00100000:1.0:1788832315.822280:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788832315.822291:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:17230:x1875726218464896:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788832315.822321:0:17245:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788832315.822334:0:17245:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788832315.827333:0:17245:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788832315.827348:0:17245:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788832315.827878:0:17267:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788832315.827883:0:17267:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788832315.827906:0:17267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d2b07cff200/0x998c12b283538191 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.827927:0:17267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c421d2a00/0x998c12b283538160 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283538159 expref: 12 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.827935:0:17267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d2b07cff200/0x998c12b283538191 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.828000:0:17267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c421d2a00/0x998c12b283538160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283538159 expref: 12 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.828015:0:17267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2c421d2a00/0x998c12b283538160 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283538159 expref: 12 pid: 17244 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832315.828030:0:17267:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17267:1875726218465024:0@lo:104: 00000100:00100000:1.0:1788832315.828105:0:17267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832315.828150:0:17267:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36dd49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832315.828202:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218465024 00000100:00100000:1.0:1788832315.828209:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218465024 00000100:00100000:1.0:1788832315.828259:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832315.828267:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e119a26-e2c8-49b5-8e81-f568246f48a1+3:17267:x1875726218465024:12345-0@lo:104: 00010000:00010000:1.0:1788832315.828280:0:17234:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b283538159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283538160 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.828330:0:17234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788832315.828336:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08550e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e119a26-e2c8-49b5-8e81-f568246f48a1+3:17267:x1875726218465024:12345-0@lo:104: Request processed in 70us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832315.828343:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832315.828392:0:17267:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17267:1875726218465024:0@lo:104: 00010000:00010000:1.0:1788832315.828412:0:17267:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d2b07cff200/0x998c12b283538191 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832315.828467:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:17230:x1875726218464896:12345-0@lo:253:mount.lustre.0 Request processed in 6179us (11108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832315.828476:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788832315.828897:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832315.828905:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b283538159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283538160 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832315.828913:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c200 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:3.0:1788832315.828917:0:17240:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b283538159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283538160 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832315.828925:0:17240:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b283538159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283538160 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832315.828932:0:17240:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b283538159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283538160 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832315.828950:0:17240:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788832315.828991:0:17240:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b283538159 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283538160 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832315.828998:0:17240:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788832315.829022:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b283538159 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283538160 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832315.829029:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b283538159 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283538160 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832315.829044:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832315.829046:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832315.829047:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832315.829084:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e119a26-e2c8-49b5-8e81-f568246f48a1:3652:1875726218465152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788832315.829120:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832315.829852:0:17230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17230:1875726218464896:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788832315.829864:0:17230:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788832315.829868:0:17230:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788832315.829878:0:17230:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788832315.829879:0:17230:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832315.829880:0:17230:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832315.829881:0:17230:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832315.829882:0:17230:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832315.829884:0:17230:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788832315.829885:0:17230:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788832315.829887:0:17230:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832315.829888:0:17230:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788832315.829902:0:17230:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788832315.831790:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218465152 00000100:00100000:1.0:1788832315.831804:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218465152 00010000:00010000:1.0:1788832315.831839:0:17236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c421d2a00/0x998c12b283538160 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283538159 expref: 12 pid: 17244 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832315.831883:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832315.831892:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:3652:x1875726218465152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788832315.831905:0:17236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832315.831910:0:17236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c421d2a00/0x998c12b283538160 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283538159 expref: 12 pid: 17244 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.831923:0:17236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c421d2a00/0x998c12b283538160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283538159 expref: 12 pid: 17244 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.831940:0:17236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c421d2a00/0x998c12b283538160 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283538159 expref: 12 pid: 17244 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.831956:0:17236:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d2b07cff200/0x998c12b283538191 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.831965:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2b07cff200/0x998c12b283538191 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788832315.831992:0:17236:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004109032s 00010000:00010000:1.0:1788832315.831996:0:17236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2b07cff200/0x998c12b283538191 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.832003:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2b07cff200/0x998c12b283538191 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.832010:0:17236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d2b07cff200/0x998c12b283538191 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.832023:0:17236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d2b07cff200/0x998c12b283538191 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.832029:0:17236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff200 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:1.0:1788832315.832034:0:17236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d2b07cff200/0x998c12b283538191 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.832042:0:17236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d2b07cff200/0x998c12b283538191 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.832059:0:17236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d2b07cff200/0x998c12b283538191 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.832232:0:17236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832315.832297:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e119a26-e2c8-49b5-8e81-f568246f48a1+11:3652:x1875726218465152:12345-0@lo:103:ldlm_bl.0 Request processed in 405us (3174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832315.832304:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788832315.832331:0:17267:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d2b07cff200/0x998c12b283538191 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.832340:0:17267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d2b07cff200/0x998c12b283538191 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832315.832346:0:17267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2b07cff200/0x998c12b283538191 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832315.832780:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e119a26-e2c8-49b5-8e81-f568246f48a1:3652:1875726218465152:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788832315.848779:0:17230:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788832315.849759:0:17230:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788832315.851328:0:17291:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788832315.851335:0:17291:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788832315.853037:0:17292:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788832315.853230:0:17230:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1788832315.855412:0:17292:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1788832315.858339:0:17293:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9d2b0756f100 x1875726218465280/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832315.858354:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c02c85cc0 going to sleep for 0 seconds 00000040:01000000:0.0:1788832315.859835:0:17230:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788832315.859885:0:17230:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788832315.860769:0:17230:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788832315.860779:0:17230:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788832315.860830:0:17230:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788832315.862018:0:17230:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788832315.862713:0:17230:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788832315.862754:0:17230:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788832315.863746:0:17292:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788832315.863803:0:17292:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1788832315.869888:0:17230:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1788832315.870430:0:17230:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1788832315.875322:0:17230:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788832315.877113:0:17230:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788832315.877151:0:17230:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb56201c13988 00100000:10000000:1.0:1788832315.877159:0:17230:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788832315.878306:0:17230:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788832315.878323:0:17230:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788832315.878340:0:17230:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788832315.878361:0:17230:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788832315.879479:0:17230:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788832315.879706:0:17230:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788832316.295695:0:17247:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788832316.295702:0:17247:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d2b07d5b800 from 7 10000000:01000000:3.0:1788832316.295707:0:17247:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788832316.295750:0:17247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832316.295761:0:17247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832316.295772:0:17247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538198 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832316.295806:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218465408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788832316.295882:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832316.295944:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c11fcaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788832316.298365:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218465408 00000100:00100000:2.0:1788832316.298380:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218465408 00000100:00100000:2.0:1788832316.298446:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788832316.298457:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+11:17247:x1875726218465408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832316.298474:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832316.298496:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c01228800/0x998c12b28353819f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283538198 expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832316.298524:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c01228800/0x998c12b28353819f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283538198 expref: 12 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832316.298536:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c01228800/0x998c12b28353819f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283538198 expref: 12 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832316.298545:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c01228800, rc 0) 00000100:00100000:2.0:1788832316.298644:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:17247:x1875726218465408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (2760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832316.298651:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788832316.298904:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218465408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832316.298927:0:17247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538198 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353819f expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832316.298939:0:17247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538198 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b28353819f expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832316.299015:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218465536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788832316.299056:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832316.299106:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36c2d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788832316.299169:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218465536 00000100:00100000:2.0:1788832316.299174:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218465536 00000100:00100000:2.0:1788832316.299211:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788832316.299219:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18d07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:17247:x1875726218465536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788832316.299234:0:17245:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788832316.299250:0:17245:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788832316.299253:0:17245:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788832316.299330:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18d07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:17247:x1875726218465536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832316.299337:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788832316.299366:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218465536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788832316.299406:0:17247:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788832316.299418:0:17247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538198 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353819f expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832316.299426:0:17247:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353819f expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832316.314942:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788832316.829004:0:17287:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788832316.829013:0:17287:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788832316.834887:0:17287:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:2.0:1788832316.834900:0:17287:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788832316.886912:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c02c85cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1788832317.335677:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788832317.846852:0:17287:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788832317.846865:0:17287:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788832317.847034:0:17287:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788832317.847081:0:17287:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788832317.847236:0:17287:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:0.0:1788832317.918280:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c02c85cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1788832318.363697:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832318.938083:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c02c85cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1788832319.390557:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788832319.856158:0:17536:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788832319.962988:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c02c85cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1788832320.406959:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788832320.791291:0:17588:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788832320.792923:0:17588:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788832320.984920:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c02c85cc0 going to sleep for 0 seconds 00000100:00080000:0.0:1788832321.238932:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788832321.238947:0:14992:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788832321.238951:0:14992:0:(import.c:65:import_set_state_nolock()) ffff9d2c3fd38800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788832321.238959:0:14992:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:0.0:1788832321.238965:0:14992:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788832321.238973:0:14992:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d2c3fd38800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788832321.238996:0:14992:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b0756e300 x1875726218465792/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788832321.239014:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788832321.239018:0:14992:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788832321.239021:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788832321.239024:0:14992:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788832321.239027:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788832321.239030:0:14992:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788832321.239031:0:14992:0:(import.c:65:import_set_state_nolock()) ffff9d2c1fe58800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788832321.239035:0:14992:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9d2c1fe58800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788832321.239046:0:14992:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b0756c700 x1875726218465920/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788832321.239071:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218465792:0@lo:38:kworker.0 00000100:00100000:0.0:1788832321.239137:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832321.239184:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875726218465920:0@lo:38:kworker.0 00000100:00100000:0.0:1788832321.239212:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832321.239267:0:17257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218465792 00000100:00100000:0.0:1788832321.239274:0:17257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218465792 00000100:00100000:0.0:1788832321.239307:0:17257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788832321.239314:0:17257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1875726218465792:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788832321.239331:0:17257:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788832321.239809:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7e119a26-e2c8-49b5-8e81-f568246f48a1:3653:1875726218465664:0@lo:400:kworker.0 00000100:00100000:3.0:1788832321.239849:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832321.239896:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218465664 00000100:00100000:3.0:1788832321.239900:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218465664 00000100:00100000:3.0:1788832321.239954:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788832321.239961:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18d07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:3653:x1875726218465664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832321.240019:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18d07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:3653:x1875726218465664:12345-0@lo:400:kworker.0 Request processed in 58us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832321.240026:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788832321.241898:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7e119a26-e2c8-49b5-8e81-f568246f48a1:3653:1875726218465664:0@lo:400:kworker.0 00000100:00100000:2.0:1788832321.242715:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218465920 00000100:00100000:2.0:1788832321.242724:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218465920 00000100:00100000:2.0:1788832321.242790:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788832321.242799:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1875726218465920:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788832321.242836:0:17253:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:2.0:1788832321.242873:0:17253:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x998c12b2835381a6 00000004:00100000:2.0:1788832321.242889:0:17253:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788832321.243035:0:17253:0:(import.c:65:import_set_state_nolock()) ffff9d2c358eb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832321.243270:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875726218465920:12345-0@lo:38:kworker.0 Request processed in 470us (4055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832321.243277:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788832321.243425:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d2b0756c700 x1875726218465920/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788832331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788832321.243441:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788832321.243456:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788832321.243461:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788832321.243463:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c1fe58800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788832321.243471:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875726218465920:0@lo:38:kworker.0 00000100:00100000:0.0:1788832321.262988:0:17257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1875726218465792:12345-0@lo:38:kworker.0 Request processed in 23666us (23843us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788832321.263002:0:17257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788832321.266932:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3fd38800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788832321.266954:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788832321.266959:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218465792:0@lo:38:kworker.0 00010000:00010000:3.0:1788832321.431294:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788832321.598874:0:17638:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788832321.599075:0:17638:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788832322.007977:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c02c85cc0 going to sleep for 0 seconds 00010000:00010000:1.0:1788832322.454743:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832323.035167:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c02c85cc0 going to sleep for 0 seconds 00010000:00010000:0.0:1788832323.480694:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832324.054963:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c02c85cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1788832324.504567:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832325.096035:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c02c85cc0 going to sleep for 0 seconds 00000100:00100000:3.0:1788832325.339435:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788832315/real 1788832315] req@ffff9d2b07f35500 x1875726218462848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788832325 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832325.339477:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d2b07f35500 x1875726218462848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788832325 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832325.339490:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788832315/real 1788832315] req@ffff9d2b07f34000 x1875726218462720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788832325 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832325.339502:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d2b07f34000 x1875726218462720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788832325 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788832325.339525:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c0aef0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788832325.339555:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788832325.339560:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218462848:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788832325.339567:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3d6f6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788832325.339582:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788832325.339587:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218462720:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788832325.341146:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1788832325.341167:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788832325.341173:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788832325.341187:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d2c3fd38800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788832325.341198:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 461 00000100:00080000:1.0:1788832325.341212:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788832325.341222:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d2c3fd38800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788832325.341255:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b08552300 x1875726218466176/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788832325.341283:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788832325.341286:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788832325.341289:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d2c3d6f6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788832325.341292:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:1.0:1788832325.341296:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788832325.341301:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d2c3d6f6000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788832325.341314:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b08550000 x1875726218466304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788832325.341326:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788832325.341328:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218466176:0@lo:38:kworker.0 00000100:00080000:1.0:1788832325.341332:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788832325.341337:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d2c0aef0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788832325.341341:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:1.0:1788832325.341344:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788832325.341369:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d2c0aef0000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788832325.341387:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b08550700 x1875726218466432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788832325.341438:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218466560:0@lo:400:kworker.0 00000100:00100000:1.0:1788832325.341498:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832325.341565:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832325.341605:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218466304:0@lo:8:kworker.0 00000400:00000100:0.0:1788832325.341840:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875726218466304 offset 0 length 520: 4 00000100:00100000:0.0:1788832325.341860:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218466432:0@lo:8:kworker.0 00000400:00000100:0.0:1788832325.341884:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875726218466432 offset 0 length 520: 4 00000100:00100000:2.0:1788832325.343018:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218466560 00000100:00100000:2.0:1788832325.343036:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218466560 00000100:00100000:2.0:1788832325.343121:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832325.343129:0:17252:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788832325.343137:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218466560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832325.343144:0:17252:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788832325.343254:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218466560:12345-0@lo:400:kworker.0 Request processed in 122us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832325.343263:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788832325.343295:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218466176 00000100:00100000:2.0:1788832325.343299:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218466176 00000100:00100000:2.0:1788832325.343326:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788832325.343332:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1875726218466176:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788832325.343354:0:17256:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788832325.343806:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7e119a26-e2c8-49b5-8e81-f568246f48a1:3653:1875726218466048:0@lo:400:kworker.0 00000100:00100000:3.0:1788832325.343871:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788832325.344024:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d2b08553b80 x1875726218466560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832325.344043:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218466560:0@lo:400:kworker.0 00000100:00100000:1.0:1788832325.344291:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218466048 00000100:00100000:1.0:1788832325.344299:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218466048 00000100:00100000:1.0:1788832325.344385:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788832325.344396:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18d05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:3653:x1875726218466048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832325.344455:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18d05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:3653:x1875726218466048:12345-0@lo:400:kworker.0 Request processed in 62us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832325.344463:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788832325.344565:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7e119a26-e2c8-49b5-8e81-f568246f48a1:3653:1875726218466048:0@lo:400:kworker.0 00000100:00100000:2.0:1788832325.366821:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1875726218466176:12345-0@lo:38:kworker.0 Request processed in 23474us (25241us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788832325.367687:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788832325.367774:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3fd38800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788832325.367782:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788832325.367787:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218466176:0@lo:38:kworker.0 00010000:00010000:3.0:1788832325.529051:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832326.105651:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c02c85cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1788832326.553076:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788832327.076883:0:17287:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788832327.126721:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c02c85cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1788832327.574855:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832328.150901:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c02c85cc0 going to sleep for 0 seconds 00010000:00010000:2.0:1788832328.598899:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788832328.970870:0:17984:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788832328.970874:0:17984:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788832328.970875:0:17984:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788832328.971955:0:17984:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d2c3fc69800 00000020:01000004:3.0:1788832328.971972:0:17984:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788832328.971995:0:17984:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788832328.972012:0:17984:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9d2c18ec8000) 00000020:00000080:3.0:1788832328.972029:0:17984:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788832329.094866:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1788832329.096437:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788832329.100532:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788832329.101118:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788832329.101314:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788832329.102253:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788832329.102540:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1788832329.103432:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788832329.107132:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788832329.107909:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788832329.109052:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788832329.109749:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788832329.110663:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788832329.111011:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788832329.111651:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788832329.112277:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788832329.112537:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788832329.112863:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788832329.113212:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788832329.113572:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788832329.113839:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788832329.114609:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788832329.115590:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788832329.116146:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788832329.122725:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788832329.123602:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788832329.126229:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788832329.126761:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788832329.127177:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788832329.127615:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788832329.131112:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788832329.131718:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788832329.132890:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788832329.133263:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788832329.133921:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788832329.134370:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788832329.137451:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788832329.137875:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1788832329.139127:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788832329.139473:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788832329.139836:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788832329.140132:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788832329.140387:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788832329.142134:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788832329.142430:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788832329.142736:0:17984:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00080000:01000000:2.0:1788832329.143740:0:17984:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788832329.143986:0:17984:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788832329.143998:0:17984:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788832329.144012:0:17984:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x998c12b2835381b4 00000020:01000004:2.0:1788832329.144019:0:17984:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788832329.144044:0:17984:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.126@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788832329.144048:0:17984:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788832329.144057:0:17984:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788832329.144085:0:17984:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788832329.144090:0:17984:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788832329.152645:0:17984:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788832329.152702:0:17984:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.126@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788832329.152706:0:17984:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788832329.152708:0:17984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788832329.152709:0:17984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788832329.152710:0:17984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788832329.152712:0:17984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788832329.152713:0:17984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788832329.152721:0:17984:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788832329.152723:0:17984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788832329.152724:0:17984:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788832329.152727:0:17984:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788832329.152729:0:17984:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788832329.152731:0:17984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788832329.152731:0:17984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788832329.152732:0:17984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788832329.152733:0:17984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788832329.152734:0:17984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788832329.152735:0:17984:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788832329.152736:0:17984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788832329.152737:0:17984:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788832329.152763:0:17984:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788832329.152782:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218466688:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788832329.152855:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832329.152938:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0760f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788832329.153006:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218466688 00000100:00100000:3.0:1788832329.153014:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218466688 00000100:00100000:3.0:1788832329.153074:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788832329.153083:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18d04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:17984:x1875726218466688:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788832329.153113:0:17245:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788832329.153116:0:17245:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788832329.153123:0:17245:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788832329.153495:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18d04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:17984:x1875726218466688:12345-0@lo:253:mount.lustre.0 Request processed in 412us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832329.153503:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788832329.153516:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218466688:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788832329.153525:0:17984:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788832329.153527:0:17984:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788832329.153528:0:17984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788832329.153529:0:17984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788832329.153530:0:17984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788832329.153531:0:17984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788832329.153532:0:17984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788832329.153533:0:17984:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788832329.153534:0:17984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788832329.153536:0:17984:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788832329.153552:0:17984:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d2c3fc69800 from lustre-MDT0001 10000000:01000000:2.0:1788832329.153578:0:17984:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788832329.153580:0:17984:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788832329.153586:0:17984:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d2b06008000 local copy 00010000:00010000:2.0:1788832329.153595:0:17984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2e00/0x998c12b2835380aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835380b1 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832329.154445:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218466816:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788832329.154501:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832329.154538:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c05580780 going to sleep for 11 seconds 00000100:00100000:1.0:1788832329.154681:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218466816 00000100:00100000:1.0:1788832329.154687:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218466816 00000100:00100000:1.0:1788832329.154733:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788832329.154742:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:17984:x1875726218466816:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788832329.154873:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:17984:x1875726218466816:12345-0@lo:501:mount.lustre.0 Request processed in 128us (367us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788832329.154880:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788832329.155232:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218466816:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788832329.155251:0:17984:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788832329.155277:0:17984:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788832329.155286:0:17984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2e00/0x998c12b2835380aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835380b1 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832329.155297:0:17984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2e00/0x998c12b2835380aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835380b1 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832329.155334:0:17984:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d2c3fc69800 10000000:01000000:3.0:1788832329.155340:0:17984:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788832329.155345:0:17984:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9d2b06008000 10000000:01000000:3.0:1788832329.155347:0:17984:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788832329.155351:0:17984:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9d2b06008000 from 1 10000000:01000000:3.0:1788832329.155354:0:17984:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788832329.155380:0:17984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2a00/0x998c12b2835381bb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832329.155388:0:17984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2a00/0x998c12b2835381bb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832329.155397:0:17984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2a00/0x998c12b2835381bb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832329.155411:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218466944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788832329.155584:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832329.155769:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3d711540 going to sleep for 11 seconds 00000100:00100000:2.0:1788832329.155816:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218466944 00000100:00100000:2.0:1788832329.155821:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218466944 00000100:00100000:2.0:1788832329.155904:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788832329.155913:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18d05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+12:17984:x1875726218466944:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788832329.156057:0:17245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832329.156072:0:17245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c01229e00/0x998c12b2835381c2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b2835381bb expref: -99 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832329.156096:0:17245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c01229e00/0x998c12b2835381c2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b2835381bb expref: 13 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832329.156107:0:17245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c01229e00/0x998c12b2835381c2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835381bb expref: 13 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832329.156117:0:17245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c01229e00, rc 0) 00000100:00100000:2.0:1788832329.156210:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18d05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+13:17984:x1875726218466944:12345-0@lo:101:mount.lustre.0 Request processed in 298us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832329.156217:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788832329.156272:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218466944:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788832329.156285:0:17984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2a00/0x998c12b2835381bb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835381c2 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832329.156295:0:17984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2a00/0x998c12b2835381bb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b2835381c2 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832329.156311:0:17984:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788832329.156329:0:17984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2a00/0x998c12b2835381bb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835381c2 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832329.156336:0:17984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2a00/0x998c12b2835381bb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835381c2 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832329.156345:0:17984:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d2c3fc69800 10000000:01000000:0.0:1788832329.156350:0:17984:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788832329.156355:0:17984:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9d2c3fc69800 from 1 10000000:01000000:0.0:1788832329.156357:0:17984:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788832329.156375:0:17984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ca00/0x998c12b2835381c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832329.156382:0:17984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ca00/0x998c12b2835381c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832329.156390:0:17984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ca00/0x998c12b2835381c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832329.156414:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218467072:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788832329.156456:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832329.156938:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788832329.157227:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218467072 00000100:00100000:3.0:1788832329.157234:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218467072 00000100:00100000:3.0:1788832329.157268:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788832329.157275:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+13:17984:x1875726218467072:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788832329.157285:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832329.157296:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c421d3e00/0x998c12b2835381d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b2835381c9 expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832329.157314:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d3e00/0x998c12b2835381d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b2835381c9 expref: 14 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832329.157339:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c421d3e00/0x998c12b2835381d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835381c9 expref: 14 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832329.157346:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d3e00, rc 0) 00000100:00100000:3.0:1788832329.157395:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+14:17984:x1875726218467072:12345-0@lo:101:mount.lustre.0 Request processed in 120us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832329.157402:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788832329.157503:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218467072:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788832329.157516:0:17984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ca00/0x998c12b2835381c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835381d0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832329.157524:0:17984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ca00/0x998c12b2835381c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b2835381d0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832329.157541:0:17984:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788832329.157559:0:17984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ca00/0x998c12b2835381c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835381d0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832329.157566:0:17984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ca00/0x998c12b2835381c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835381d0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832329.157573:0:17984:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788832329.157578:0:17984:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788832329.157582:0:17984:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d2c3fc69800 10000000:01000000:0.0:1788832329.157585:0:17984:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788832329.157588:0:17984:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788832329.157590:0:17984:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788832329.157608:0:17984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b2835381d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832329.157615:0:17984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b2835381d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832329.157649:0:17984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b2835381d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832329.157664:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218467200:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788832329.157694:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832329.157708:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788832329.157892:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218467200 00000100:00100000:3.0:1788832329.157897:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218467200 00000100:00100000:3.0:1788832329.157929:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788832329.157936:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+14:17984:x1875726218467200:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788832329.157944:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832329.157952:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c421d3a00/0x998c12b2835381de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b2835381d7 expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832329.157966:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d3a00/0x998c12b2835381de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b2835381d7 expref: 15 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832329.157983:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c421d3a00/0x998c12b2835381de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835381d7 expref: 15 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832329.157990:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d3a00, rc 0) 00000100:00100000:3.0:1788832329.158026:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+15:17984:x1875726218467200:12345-0@lo:101:mount.lustre.0 Request processed in 90us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832329.158032:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788832329.158272:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218467200:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788832329.158283:0:17984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b2835381d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835381de expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832329.158291:0:17984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b2835381d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b2835381de expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788832329.159869:0:17984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1788832329.160722:0:17984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788832329.168137:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788832329.168195:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788832329.168212:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788832329.168227:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788832329.168241:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1788832329.168256:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1788832329.168271:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1788832329.168287:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788832329.168304:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788832329.168320:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1788832329.168332:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1788832329.168344:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1788832329.168356:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1788832329.168370:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788832329.168396:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788832329.168409:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1788832329.168420:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788832329.168432:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788832329.168460:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1788832329.168475:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788832329.168799:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788832329.168815:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788832329.168829:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788832329.168859:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1788832329.168865:0:17984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1788832329.169133:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218467328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788832329.169197:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832329.169300:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7780 going to sleep for 11 seconds 00000100:00100000:3.0:1788832329.170274:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218467328 00000100:00100000:3.0:1788832329.170283:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218467328 00000100:00100000:3.0:1788832329.170374:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788832329.170384:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+15:17984:x1875726218467328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788832329.171152:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+15:17984:x1875726218467328:12345-0@lo:501:mount.lustre.0 Request processed in 768us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832329.171161:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788832329.171892:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218467328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788832329.172079:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218467456:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788832329.172134:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832329.172160:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788832329.172228:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218467456 00000100:00100000:1.0:1788832329.172234:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218467456 00000100:00100000:1.0:1788832329.172300:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788832329.172309:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+15:17984:x1875726218467456:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788832329.173182:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+15:17984:x1875726218467456:12345-0@lo:503:mount.lustre.0 Request processed in 871us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832329.173197:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788832329.173283:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218467456:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788832329.173730:0:17984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788832329.173800:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218467584:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788832329.173843:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832329.173879:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7540 going to sleep for 11 seconds 00000100:00100000:2.0:1788832329.174009:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218467584 00000100:00100000:2.0:1788832329.174016:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218467584 00000100:00100000:2.0:1788832329.174137:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788832329.174147:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+15:17984:x1875726218467584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788832329.175509:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+15:17984:x1875726218467584:12345-0@lo:502:mount.lustre.0 Request processed in 1358us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832329.175520:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788832329.176701:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c02c85cc0 going to sleep for 0 seconds 00000100:00100000:0.0:1788832329.177180:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218467584:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788832329.177398:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788832329.177430:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1788832329.178694:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1788832329.178740:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1788832329.178752:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1788832329.178763:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1788832329.178773:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1788832329.178783:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1788832329.178793:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1788832329.178804:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1788832329.178814:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1788832329.178827:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1788832329.178838:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1788832329.178850:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1788832329.178864:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1788832329.178875:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1788832329.179408:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1788832329.179429:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1788832329.179442:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1788832329.179464:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1788832329.179476:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1788832329.179593:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1788832329.179607:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1788832329.179683:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1788832329.179700:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1788832329.179712:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1788832329.179722:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1788832329.179733:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1788832329.179743:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1788832329.179753:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1788832329.179779:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1788832329.179791:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1788832329.179801:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1788832329.179812:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1788832329.179822:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1788832329.179833:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1788832329.179853:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1788832329.179866:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1788832329.179880:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1788832329.181256:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1788832329.181275:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1788832329.181298:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1788832329.181315:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1788832329.181329:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1788832329.181382:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218467712:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788832329.182539:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832329.182590:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788832329.184260:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218467712 00000100:00100000:3.0:1788832329.184274:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218467712 00000100:00100000:3.0:1788832329.184347:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788832329.184357:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+15:17984:x1875726218467712:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788832329.184544:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+15:17984:x1875726218467712:12345-0@lo:502:mount.lustre.0 Request processed in 188us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832329.184553:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788832329.184593:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218467712:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788832329.184724:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1788832329.184738:0:17984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1788832329.185397:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832329.185409:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832329.185411:0:17988:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788832329.185416:0:17988:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788832329.185419:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788832329.185432:0:17988:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9d2c35828000) 00000020:00000080:2.0:1788832329.185452:0:17988:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1788832329.185458:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788832329.185534:0:17988:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788832329.185541:0:17988:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x998c12b2835381ec 00000020:00000080:2.0:1788832329.185890:0:17988:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788832329.185896:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788832329.185900:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832329.185902:0:17988:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788832329.185958:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788832329.185964:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832329.185966:0:17988:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788832329.185969:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788832329.185977:0:17988:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9d2c3582cd28) 00000020:00000080:2.0:1788832329.185988:0:17988:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1788832329.185992:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788832329.185994:0:17988:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788832329.185997:0:17988:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788832329.186003:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788832329.186058:0:17988:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d2c3fc69800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788832329.186070:0:17988:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9d2c3582b370) 00000020:00000080:2.0:1788832329.186080:0:17988:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1788832329.186145:0:17988:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788832329.186151:0:17988:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x998c12b283538201 00000020:00000080:2.0:1788832329.186241:0:17988:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788832329.186254:0:17988:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788832329.186258:0:17988:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x998c12b283538208 00080000:01000000:2.0:1788832329.186264:0:17988:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788832329.186268:0:17988:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x998c12b28353820f 00010000:00010000:0.0:1788832329.304230:0:17988:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1788832329.304823:0:17988:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1788832329.306037:0:17988:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788832329.308351:0:17988:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788832329.308366:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832329.308375:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832329.308377:0:17988:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788832329.308381:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832329.308386:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832329.308387:0:17988:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788832329.308390:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788832329.308395:0:17988:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:00000080:0.0:1788832329.308423:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788832329.308439:0:17988:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9d2b0600b370) 00000020:00000080:0.0:1788832329.308472:0:17988:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1788832329.308479:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788832329.308583:0:17988:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788832329.308590:0:17988:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788832329.308597:0:17988:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x998c12b28353821d 00010000:00080000:0.0:1788832329.308674:0:17988:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2c36d21800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:0.0:1788832329.316535:0:17988:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1788832329.320931:0:17988:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788832329.320946:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788832329.320991:0:17988:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788832329.321011:0:17988:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x998c12b283538224 00000100:00080000:1.0:1788832329.321021:0:17988:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788832329.321028:0:17988:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9d2c36d21800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788832329.321063:0:17988:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b08553800 x1875726218467840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788832329.321397:0:17988:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788832329.321425:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788832329.321430:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788832329.321433:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d2c3fd38800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788832329.321437:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:1.0:1788832329.321441:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788832329.321456:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d2c3fd38800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788832329.321473:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b08550a80 x1875726218467968/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788832329.321484:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788832329.321488:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788832329.321491:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788832329.321493:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788832329.321535:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875726218468096:0@lo:400:kworker.0 00000100:00100000:1.0:1788832329.321608:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788832329.321732:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832329.321737:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832329.321739:0:17988:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788832329.321741:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788832329.321744:0:17988:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788832329.321746:0:17988:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788832329.321747:0:17988:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788832329.321748:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788832329.321750:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832329.321751:0:17988:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788832329.321754:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832329.321757:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832329.321759:0:17988:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788832329.321762:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788832329.321795:0:17988:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788832329.321809:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832329.321812:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832329.321813:0:17988:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788832329.321816:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788832329.321817:0:17988:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1788832329.321818:0:17988:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788832329.321820:0:17988:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788832329.321821:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788832329.321823:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832329.321824:0:17988:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788832329.321827:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788832329.321830:0:17988:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788832329.321833:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832329.321835:0:17988:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788832329.321837:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788832329.321841:0:17988:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:1.0:1788832329.321861:0:17988:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788832329.321870:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788832329.321893:0:17988:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9d2c3fd1cd28) 00000020:00000080:1.0:1788832329.321911:0:17988:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788832329.321918:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788832329.321988:0:17988:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788832329.321994:0:17988:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788832329.322001:0:17988:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x998c12b283538232 00010000:00080000:1.0:1788832329.322030:0:17988:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2c054a5800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:1.0:1788832329.322261:0:17988:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1788832329.323335:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218467840:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788832329.323393:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832329.323451:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218467968:0@lo:38:kworker.0 00000100:00100000:3.0:1788832329.323476:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832329.323522:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218468096 00000100:00100000:3.0:1788832329.323530:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218468096 00000100:00100000:3.0:1788832329.323573:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788832329.323582:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875726218468096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832329.323667:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875726218468096:12345-0@lo:400:kworker.0 Request processed in 86us (2059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832329.323675:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788832329.323719:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d2b08553100 x1875726218468096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832329.323744:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875726218468096:0@lo:400:kworker.0 00000100:00100000:3.0:1788832329.323779:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218467840 00000100:00100000:3.0:1788832329.323783:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218467840 00000100:00100000:3.0:1788832329.323794:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218467968 00000100:00100000:3.0:1788832329.323797:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218467968 00000100:00100000:3.0:1788832329.323806:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788832329.323810:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1875726218467840:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788832329.323831:0:17256:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:3.0:1788832329.323860:0:17256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x998c12b283538239 00000004:00100000:3.0:1788832329.323875:0:17256:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788832329.323892:0:17256:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:1.0:1788832329.324239:0:17988:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788832329.324537:0:17988:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1788832329.328140:0:17256:0:(import.c:65:import_set_state_nolock()) ffff9d2c1fe5f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788832329.328239:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875726218467840:12345-0@lo:38:llog_process_th.0 Request processed in 4425us (4843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832329.328250:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788832329.328278:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788832329.328284:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1875726218467968:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788832329.328331:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1875726218467968:12345-0@lo:38:kworker.0 Request processed in 46us (4854us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788832329.328337:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788832329.328615:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788832329.328666:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788832329.328675:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788832329.328680:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788832329.328683:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c36d21800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788832329.328695:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218467840:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788832329.328707:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788832329.328710:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3fd38800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788832329.328713:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788832329.328716:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218467968:0@lo:38:kworker.0 00000100:00100000:3.0:1788832329.329297:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218468224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788832329.329342:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788832329.329454:0:17988:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788832329.329699:0:17257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218468224 00000100:00100000:0.0:1788832329.329707:0:17257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218468224 00000100:00100000:0.0:1788832329.329752:0:17257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788832329.329761:0:17257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875726218468224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788832329.329787:0:17257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788832329.329840:0:17257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1875726218468224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832329.329847:0:17257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788832329.329868:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218468224:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788832329.330038:0:17988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788832329.330187:0:17988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:1.0:1788832329.331195:0:17993:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788832329.331201:0:17993:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788832329.335543:0:17988:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788832329.335560:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788832329.335610:0:17988:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788832329.335902:0:17988:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x998c12b283538240 00000100:00080000:3.0:1788832329.335914:0:17988:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788832329.335929:0:17988:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9d2c054a5800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788832329.335965:0:17988:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c3fd0ed80 x1875726218468352/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788832329.336027:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218468352:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788832329.336080:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875726218468352 offset 0 length 520: 4 00000100:00080000:3.0:1788832329.336132:0:17988:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788832329.336235:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832329.336241:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832329.336243:0:17988:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788832329.336247:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788832329.336249:0:17988:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788832329.336251:0:17988:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788832329.336252:0:17988:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788832329.336253:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788832329.336256:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832329.336257:0:17988:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788832329.336260:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788832329.336264:0:17988:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788832329.336267:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832329.336269:0:17988:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788832329.336272:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788832329.336275:0:17988:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.126@tcp to nid 0x20000c0a8cb7e (192.168.203.126@tcp) 00000020:01000000:3.0:1788832329.336298:0:17988:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788832329.336300:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788832329.336313:0:17988:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9d2c18ec99b8) 00000020:00000080:3.0:1788832329.336327:0:17988:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788832329.336332:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788832329.336409:0:17988:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788832329.336418:0:17988:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788832329.336424:0:17988:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x998c12b28353824e 00010000:00080000:3.0:1788832329.336452:0:17988:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2c39187000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:3.0:1788832329.336684:0:17988:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788832329.336753:0:17988:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788832329.336774:0:17988:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1788832329.338424:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788832329.338431:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788832329.338434:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788832329.338436:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788832329.338732:0:17988:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788832329.338988:0:17988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788832329.339156:0:17988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788832329.339832:0:17995:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788832329.339837:0:17995:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788832329.343014:0:17988:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788832329.343030:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788832329.343076:0:17988:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788832329.343100:0:17988:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x998c12b283538255 00000100:00080000:3.0:1788832329.343111:0:17988:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788832329.343117:0:17988:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d2c39187000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788832329.343154:0:17988:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c3fd0c380 x1875726218468480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788832329.343233:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218468480:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788832329.343285:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875726218468480 offset 0 length 520: 4 00000100:00080000:3.0:1788832329.343343:0:17988:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788832329.343406:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832329.343411:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832329.343413:0:17988:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788832329.343417:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832329.343421:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832329.343423:0:17988:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788832329.343427:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788832329.343429:0:17988:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788832329.343431:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832329.343434:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832329.343435:0:17988:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788832329.343437:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832329.343439:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832329.343440:0:17988:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788832329.343443:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788832329.343472:0:17988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832329.343475:0:17988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832329.343477:0:17988:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000100:00080000:1.0:1788832329.343568:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788832329.343574:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788832329.343576:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788832329.343579:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788832329.343615:0:17988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1788832329.346407:0:17984:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788832329.346460:0:17984:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788832329.347370:0:17984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b2835381d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835381de expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832329.347384:0:17984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c000/0x998c12b2835381d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835381de expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832329.347394:0:17984:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d2c3fc69800 from 1 10000000:01000000:0.0:1788832329.347397:0:17984:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788832329.347434:0:17984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d200/0x998c12b28353825c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832329.347439:0:17984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d200/0x998c12b28353825c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832329.347449:0:17984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d200/0x998c12b28353825c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832329.347474:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218468608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788832329.347562:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832329.347601:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832329.347602:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218468608 00000100:00100000:3.0:1788832329.347610:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218468608 00000100:00100000:3.0:1788832329.347680:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788832329.347689:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+15:17984:x1875726218468608:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788832329.347705:0:17245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832329.347719:0:17245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c421d2000/0x998c12b283538263 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b28353825c expref: -99 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832329.347742:0:17245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d2000/0x998c12b283538263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b28353825c expref: 16 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832329.347753:0:17245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c421d2000/0x998c12b283538263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b28353825c expref: 16 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832329.347761:0:17245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2000, rc 0) 00000100:00100000:3.0:1788832329.348118:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+16:17984:x1875726218468608:12345-0@lo:101:mount.lustre.0 Request processed in 428us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832329.348126:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788832329.348207:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218468608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788832329.348219:0:17984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d200/0x998c12b28353825c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538263 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832329.348225:0:17984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d200/0x998c12b28353825c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283538263 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832329.348861:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218468736:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788832329.348921:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832329.348954:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832329.349137:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218468736 00000100:00100000:3.0:1788832329.349144:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218468736 00000100:00100000:3.0:1788832329.349183:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788832329.349190:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+16:17984:x1875726218468736:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788832329.349206:0:17243:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788832329.349223:0:17243:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788832329.349227:0:17243:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788832329.349440:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+16:17984:x1875726218468736:12345-0@lo:256:mount.lustre.0 Request processed in 250us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832329.349457:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788832329.349599:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218468736:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788832329.350479:0:17984:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788832329.350538:0:17984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d200/0x998c12b28353825c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538263 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.350550:0:17984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d200/0x998c12b28353825c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538263 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832329.350558:0:17984:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2c3fc69800 from 1 10000000:01000000:1.0:1788832329.350561:0:17984:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788832329.350595:0:17984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2b07cff000/0x998c12b28353826a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.350603:0:17984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2b07cff000/0x998c12b28353826a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.350612:0:17984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2b07cff000/0x998c12b28353826a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832329.350651:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218468864:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788832329.350697:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832329.350738:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b0720db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832329.350800:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218468864 00000100:00100000:2.0:1788832329.350806:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218468864 00000100:00100000:2.0:1788832329.350851:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788832329.350860:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+16:17984:x1875726218468864:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788832329.350870:0:17245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832329.350904:0:17245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c01229600/0x998c12b283538271 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b28353826a expref: -99 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832329.350932:0:17245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c01229600/0x998c12b283538271 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b28353826a expref: 17 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832329.350942:0:17245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c01229600/0x998c12b283538271 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b28353826a expref: 17 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832329.350950:0:17245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c01229600, rc 0) 00000100:00100000:2.0:1788832329.350995:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+17:17984:x1875726218468864:12345-0@lo:101:mount.lustre.0 Request processed in 137us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832329.351002:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788832329.351172:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218468864:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788832329.351185:0:17984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2b07cff000/0x998c12b28353826a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538271 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.351193:0:17984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2b07cff000/0x998c12b28353826a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283538271 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788832329.351314:0:17984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788832329.351348:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218468992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788832329.351374:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832329.351408:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0ff98600 going to sleep for 11 seconds 00000100:00100000:0.0:1788832329.351698:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218468992 00000100:00100000:0.0:1788832329.351703:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218468992 00000100:00100000:0.0:1788832329.351739:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788832329.351747:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+17:17984:x1875726218468992:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788832329.351840:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+17:17984:x1875726218468992:12345-0@lo:501:mount.lustre.0 Request processed in 93us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832329.351846:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788832329.352017:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218468992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788832329.352047:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218469120:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788832329.352091:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832329.352119:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0ff98600 going to sleep for 11 seconds 00000100:00100000:0.0:1788832329.352167:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218469120 00000100:00100000:0.0:1788832329.352171:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218469120 00000100:00100000:0.0:1788832329.352200:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788832329.352206:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+17:17984:x1875726218469120:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788832329.352287:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+17:17984:x1875726218469120:12345-0@lo:503:mount.lustre.0 Request processed in 81us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832329.352293:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788832329.352449:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218469120:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788832329.352835:0:17984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788832329.352929:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218469248:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788832329.352967:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832329.352986:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3916bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788832329.353156:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218469248 00000100:00100000:2.0:1788832329.353161:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218469248 00000100:00100000:2.0:1788832329.353198:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788832329.353206:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+17:17984:x1875726218469248:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788832329.353301:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+17:17984:x1875726218469248:12345-0@lo:502:mount.lustre.0 Request processed in 95us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832329.353308:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788832329.353569:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218469248:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788832329.353800:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788832329.353828:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1788832329.353845:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1788832329.353861:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1788832329.353876:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1788832329.353905:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1788832329.353931:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1788832329.353945:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1788832329.353958:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788832329.353971:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1788832329.353984:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1788832329.354009:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218469376:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788832329.354049:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832329.354084:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3916bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832329.354121:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218469376 00000100:00100000:3.0:1788832329.354133:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218469376 00000100:00100000:3.0:1788832329.354172:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788832329.354179:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+17:17984:x1875726218469376:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788832329.354761:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+17:17984:x1875726218469376:12345-0@lo:502:mount.lustre.0 Request processed in 579us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832329.354769:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788832329.354996:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218469376:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788832329.355052:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1788832329.355062:0:17984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788832329.356106:0:17997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832329.356117:0:17997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832329.356119:0:17997:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788832329.356128:0:17997:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d2c3fc69800 00000020:00000080:3.0:1788832329.356130:0:17997:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788832329.356138:0:17997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832329.356141:0:17997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832329.356142:0:17997:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788832329.356144:0:17997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832329.356146:0:17997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832329.356148:0:17997:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788832329.356152:0:17997:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d2c3fc69800 00000020:00000080:3.0:1788832329.356154:0:17997:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788832329.356212:0:17997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832329.356216:0:17997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832329.356217:0:17997:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788832329.356220:0:17997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832329.356222:0:17997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832329.356224:0:17997:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788832329.356227:0:17997:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d2c3fc69800 00000020:00000080:3.0:1788832329.356230:0:17997:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788832329.356247:0:17997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832329.356250:0:17997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832329.356252:0:17997:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788832329.356254:0:17997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832329.356256:0:17997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832329.356265:0:17997:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788832329.356270:0:17997:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d2c3fc69800 00000020:00000080:3.0:1788832329.356272:0:17997:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788832329.356299:0:17997:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832329.356302:0:17997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832329.356304:0:17997:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788832329.356306:0:17997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1788832329.358063:0:17984:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788832329.358107:0:17984:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788832329.360379:0:17984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2b07cff000/0x998c12b28353826a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538271 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832329.360396:0:17984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2b07cff000/0x998c12b28353826a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538271 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832329.360546:0:17984:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788832329.360550:0:17984:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d2c3fc69800 10000000:01000000:0.0:1788832329.360609:0:17984:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d2c3fc69800 10000000:01000000:0.0:1788832329.360615:0:17984:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788832329.360638:0:17984:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d2c3fc69800 from 1 10000000:01000000:0.0:1788832329.360641:0:17984:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788832329.360736:0:17984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d400/0x998c12b283538278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832329.360746:0:17984:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d400/0x998c12b283538278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832329.360758:0:17984:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d400/0x998c12b283538278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832329.360783:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218469504:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788832329.360849:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832329.360903:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218469504 00000100:00100000:0.0:1788832329.360910:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218469504 00000100:00100000:0.0:1788832329.360954:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788832329.360963:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+17:17984:x1875726218469504:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788832329.360976:0:17245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832329.360997:0:17245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c1fe0d000/0x998c12b28353827f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283538278 expref: -99 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832329.361019:0:17245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c1fe0d000/0x998c12b28353827f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283538278 expref: 18 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832329.361031:0:17245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c1fe0d000/0x998c12b28353827f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283538278 expref: 18 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832329.361040:0:17245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0d000, rc 0) 00000100:00100000:0.0:1788832329.361072:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:17984:x1875726218469504:12345-0@lo:101:mount.lustre.0 Request processed in 111us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832329.361079:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788832329.361119:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832329.361152:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218469504:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788832329.361166:0:17984:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d400/0x998c12b283538278 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353827f expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832329.361175:0:17984:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d400/0x998c12b283538278 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b28353827f expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788832329.363810:0:17984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788832329.364116:0:17984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788832329.364292:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788832329.364314:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1788832329.364326:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1788832329.364338:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1788832329.364349:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1788832329.364361:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1788832329.364372:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1788832329.364391:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1788832329.364402:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1788832329.364412:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1788832329.364423:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1788832329.364433:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1788832329.364457:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1788832329.364472:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1788832329.364604:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1788832329.364649:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1788832329.364667:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1788832329.364679:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1788832329.364692:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1788832329.364703:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1788832329.364714:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1788832329.364725:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1788832329.364736:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1788832329.364747:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1788832329.364758:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1788832329.364769:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1788832329.364780:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1788832329.364792:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1788832329.364821:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1788832329.364827:0:17984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788832329.365994:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218469632:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788832329.366070:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832329.366124:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788832329.366774:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218469632 00000100:00100000:1.0:1788832329.366783:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218469632 00000100:00100000:1.0:1788832329.366828:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788832329.366837:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:17984:x1875726218469632:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788832329.367164:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:17984:x1875726218469632:12345-0@lo:501:mount.lustre.0 Request processed in 328us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832329.367171:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788832329.367220:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218469632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788832329.367262:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218469760:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788832329.367302:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832329.367326:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218469760 00000100:00100000:1.0:1788832329.367330:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218469760 00000100:00100000:1.0:1788832329.367353:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788832329.367358:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:17984:x1875726218469760:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788832329.367425:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:17984:x1875726218469760:12345-0@lo:503:mount.lustre.0 Request processed in 65us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832329.367431:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788832329.368562:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832329.368588:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218469760:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788832329.369916:0:17984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788832329.370606:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218469888:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788832329.370692:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832329.370738:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832329.370820:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218469888 00000100:00100000:0.0:1788832329.370827:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218469888 00000100:00100000:0.0:1788832329.372038:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788832329.372053:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:17984:x1875726218469888:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788832329.372198:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:17984:x1875726218469888:12345-0@lo:502:mount.lustre.0 Request processed in 149us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832329.372212:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788832329.372277:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218469888:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788832329.372481:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788832329.372509:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1788832329.372523:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1788832329.372534:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1788832329.372546:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1788832329.372557:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1788832329.372569:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1788832329.372580:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1788832329.372591:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1788832329.372602:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1788832329.372612:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1788832329.372643:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1788832329.372661:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1788832329.372673:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1788832329.372686:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1788832329.372701:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1788832329.372714:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1788832329.372726:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1788832329.372738:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1788832329.372751:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1788832329.372764:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1788832329.372778:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1788832329.372807:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1788832329.372825:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1788832329.372838:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1788832329.372848:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1788832329.372859:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1788832329.372872:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1788832329.372914:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1788832329.374215:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1788832329.374235:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1788832329.374247:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1788832329.374259:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1788832329.374271:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1788832329.374286:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1788832329.375059:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1788832329.375087:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1788832329.375101:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1788832329.375132:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1788832329.375148:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1788832329.375334:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1788832329.375352:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1788832329.375366:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1788832329.375379:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1788832329.375392:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1788832329.375404:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1788832329.375416:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1788832329.375430:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1788832329.375495:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218470016:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788832329.375569:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832329.375612:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218470016 00000100:00100000:0.0:1788832329.375635:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218470016 00000100:00100000:0.0:1788832329.375681:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788832329.375690:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:17984:x1875726218470016:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788832329.380752:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:17984:x1875726218470016:12345-0@lo:502:mount.lustre.0 Request processed in 5053us (5173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832329.380854:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788832329.381928:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b073b7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788832329.381971:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218470016:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788832329.382436:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1788832329.382543:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1788832329.382583:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08551c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218470144:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788832329.383551:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832329.383601:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788832329.384280:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218470144 00000100:00100000:0.0:1788832329.384297:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218470144 00000100:00100000:0.0:1788832329.384355:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788832329.384365:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:17984:x1875726218470144:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788832329.384582:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:17984:x1875726218470144:12345-0@lo:502:mount.lustre.0 Request processed in 217us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832329.384590:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788832329.384635:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08551c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218470144:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788832329.384715:0:17984:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1788832329.384728:0:17984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788832329.392394:0:18002:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788832329.392411:0:18002:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9d2c3fd18000) 00000020:00000080:1.0:1788832329.392434:0:18002:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788832329.392519:0:18002:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d2c3fc69800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788832329.392523:0:18002:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d2c3fc69800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788832329.392526:0:18002:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d2c3fc69800 3 00010000:00080000:1.0:1788832329.392565:0:18002:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2b073a5000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.126@tcp at head 00010000:00010000:1.0:1788832329.396695:0:18002:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788832329.397198:0:18002:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788832329.397241:0:18002:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788832329.397253:0:18002:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x998c12b28353828d 00000100:00080000:1.0:1788832329.397263:0:18002:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788832329.397268:0:18002:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9d2b073a5000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788832329.397302:0:18002:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b08552680 x1875726218470272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788832329.397329:0:18002:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788832329.397354:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788832329.397358:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788832329.397367:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788832329.397370:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788832329.397585:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875726218470272:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788832329.397675:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832329.399827:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218470272 00000100:00100000:1.0:1788832329.399840:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218470272 00000100:00100000:1.0:1788832329.399930:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788832329.399939:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1875726218470272:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788832329.399966:0:17252:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:1.0:1788832329.400002:0:17252:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x998c12b283538294 00000004:00100000:1.0:1788832329.400018:0:17252:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788832329.400056:0:17252:0:(import.c:65:import_set_state_nolock()) ffff9d2c054a4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788832329.400144:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875726218470272:12345-0@lo:38:llog_process_th.0 Request processed in 204us (2467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832329.400151:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788832329.404227:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d2b08552680 x1875726218470272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788832339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832329.404241:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788832329.404259:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788832329.404268:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788832329.404274:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788832329.404278:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2b073a5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788832329.404286:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875726218470272:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788832329.404866:0:18002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1788832329.405648:0:17984:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788832329.405680:0:17984:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788832329.405699:0:17984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d400/0x998c12b283538278 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353827f expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832329.405711:0:17984:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d400/0x998c12b283538278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353827f expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788832329.405765:0:17984:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788832329.405767:0:17984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788832329.405769:0:17984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788832329.405775:0:17984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788832329.405777:0:17984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788832329.405778:0:17984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788832329.405780:0:17984:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788832329.405781:0:17984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788832329.405783:0:17984:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788832329.405787:0:17984:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788832329.405790:0:17984:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788832329.405791:0:17984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788832329.405792:0:17984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788832329.405793:0:17984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788832329.405794:0:17984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788832329.405795:0:17984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788832329.405796:0:17984:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788832329.405797:0:17984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788832329.405798:0:17984:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788832329.405827:0:17984:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788832329.405845:0:17984:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218470400:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788832329.405924:0:17984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832329.405966:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218470400 00000100:00100000:3.0:1788832329.405972:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218470400 00000100:00100000:3.0:1788832329.406014:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788832329.406023:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:17984:x1875726218470400:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788832329.406048:0:17245:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788832329.406061:0:17245:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788832329.406687:0:17984:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0927fb40 going to sleep for 11 seconds 00000001:00100000:0.0:1788832329.412788:0:17231:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788832329.412943:0:17245:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788832329.412960:0:17245:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788832329.413163:0:17267:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788832329.413169:0:17267:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788832329.413193:0:17267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d2b07cfe800/0x998c12b28353829b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.413212:0:17267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c01228800/0x998c12b28353819f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283538198 expref: 18 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.413221:0:17267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c421d2000/0x998c12b283538263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b28353825c expref: 18 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.413228:0:17267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d2b07cfe800/0x998c12b28353829b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.413268:0:17267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c421d2000/0x998c12b283538263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b28353825c expref: 18 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.413294:0:17267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2c421d2000/0x998c12b283538263 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b28353825c expref: 18 pid: 17245 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832329.413308:0:17267:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08551500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17267:1875726218470528:0@lo:104: 00000100:00100000:1.0:1788832329.413373:0:17267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788832329.413431:0:17267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c01228800/0x998c12b28353819f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283538198 expref: 18 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.413439:0:17267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2c01228800/0x998c12b28353819f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283538198 expref: 18 pid: 17243 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832329.413603:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218470528 00000100:00100000:0.0:1788832329.413611:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218470528 00000100:00100000:0.0:1788832329.413690:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788832329.413699:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e119a26-e2c8-49b5-8e81-f568246f48a1+3:17267:x1875726218470528:12345-0@lo:104: 00010000:00010000:0.0:1788832329.413711:0:17235:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d200/0x998c12b28353825c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283538263 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832329.413758:0:17235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788832329.413764:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e119a26-e2c8-49b5-8e81-f568246f48a1+3:17267:x1875726218470528:12345-0@lo:104: Request processed in 67us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832329.413770:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788832329.413849:0:17267:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08551f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17267:1875726218470656:0@lo:104: 00000100:00100000:1.0:1788832329.413874:0:17267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832329.413905:0:17267:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b4600 going to sleep for 11 seconds 00000100:00100000:1.0:1788832329.413924:0:17267:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08551500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17267:1875726218470528:0@lo:104: 00000100:00100000:1.0:1788832329.413941:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218470656 00000100:00100000:1.0:1788832329.413944:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218470656 00000100:00100000:1.0:1788832329.413963:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788832329.413968:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08553480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e119a26-e2c8-49b5-8e81-f568246f48a1+3:17267:x1875726218470656:12345-0@lo:104: 00010000:00010000:1.0:1788832329.413976:0:17234:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b28353819f expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.414016:0:17234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788832329.414022:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08553480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e119a26-e2c8-49b5-8e81-f568246f48a1+3:17267:x1875726218470656:12345-0@lo:104: Request processed in 54us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832329.414028:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788832329.414050:0:17267:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08551f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17267:1875726218470656:0@lo:104: 00010000:00010000:1.0:1788832329.414077:0:17267:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d2b07cfe800/0x998c12b28353829b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.414094:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788832329.414101:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d200/0x998c12b28353825c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283538263 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.414108:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0d200 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:1.0:1788832329.414112:0:17239:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d200/0x998c12b28353825c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283538263 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.414120:0:17239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d200/0x998c12b28353825c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283538263 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788832329.414126:0:17239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d200/0x998c12b28353825c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283538263 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832329.414131:0:17239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788832329.414159:0:17239:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d200/0x998c12b28353825c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283538263 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.414165:0:17239:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788832329.414185:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d200/0x998c12b28353825c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283538263 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.414192:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d200/0x998c12b28353825c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283538263 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.414203:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832329.414206:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b28353819f expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.414221:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2200 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:1.0:1788832329.414224:0:17239:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b28353819f expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.414230:0:17239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b28353819f expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788832329.414236:0:17239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b28353819f expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832329.414240:0:17239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788832329.414253:0:17239:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538198 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353819f expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.414259:0:17239:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788832329.414273:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538198 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353819f expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.414280:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538198 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353819f expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.414295:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832329.414297:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832329.414299:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832329.414311:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e119a26-e2c8-49b5-8e81-f568246f48a1:3654:1875726218470784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788832329.414339:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832329.414370:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e119a26-e2c8-49b5-8e81-f568246f48a1:3651:1875726218470912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788832329.414391:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832329.414431:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218470784 00000100:00100000:1.0:1788832329.414435:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218470784 00010000:00010000:3.0:1788832329.414673:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832329.414730:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+19:17984:x1875726218470400:12345-0@lo:253:mount.lustre.0 Request processed in 8707us (8805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832329.414739:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788832329.414848:0:17984:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:17984:1875726218470400:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788832329.414859:0:17984:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788832329.414863:0:17984:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788832329.414864:0:17984:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788832329.414865:0:17984:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832329.414866:0:17984:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832329.414868:0:17984:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832329.414869:0:17984:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832329.414870:0:17984:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788832329.414872:0:17984:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832329.414890:0:17984:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788832329.414905:0:17984:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788832329.417639:0:17236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c421d2000/0x998c12b283538263 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b28353825c expref: 18 pid: 17245 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832329.417688:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218470912 00000100:00100000:1.0:1788832329.417695:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218470912 00010000:00010000:1.0:1788832329.417720:0:17236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c01228800/0x998c12b28353819f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283538198 expref: 19 pid: 17243 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832329.417735:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788832329.417744:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08552680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e119a26-e2c8-49b5-8e81-f568246f48a1+19:3654:x1875726218470784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788832329.417757:0:17236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832329.417762:0:17236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c421d2000/0x998c12b283538263 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b28353825c expref: 19 pid: 17245 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.417775:0:17236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c421d2000/0x998c12b283538263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b28353825c expref: 19 pid: 17245 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.417791:0:17236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c421d2000/0x998c12b283538263 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b28353825c expref: 19 pid: 17245 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.417807:0:17236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832329.417875:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08552680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:3654:x1875726218470784:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (3535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832329.417894:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788832329.417910:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788832329.417916:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08551c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e119a26-e2c8-49b5-8e81-f568246f48a1+17:3651:x1875726218470912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788832329.417924:0:17236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832329.417929:0:17236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c01228800/0x998c12b28353819f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283538198 expref: 17 pid: 17243 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.417948:0:17236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c01228800/0x998c12b28353819f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283538198 expref: 17 pid: 17243 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.417958:0:17236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c01228800/0x998c12b28353819f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283538198 expref: 17 pid: 17243 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.417968:0:17236:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d2b07cfe800/0x998c12b28353829b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.417976:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2b07cfe800/0x998c12b28353829b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788832329.417991:0:17236:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004822926s 00010000:00010000:1.0:1788832329.417995:0:17236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2b07cfe800/0x998c12b28353829b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.418002:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2b07cfe800/0x998c12b28353829b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.418008:0:17236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d2b07cfe800/0x998c12b28353829b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.418014:0:17236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d2b07cfe800/0x998c12b28353829b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.418019:0:17236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe800 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:1.0:1788832329.418023:0:17236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d2b07cfe800/0x998c12b28353829b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.418031:0:17236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d2b07cfe800/0x998c12b28353829b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.418053:0:17236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d2b07cfe800/0x998c12b28353829b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.418062:0:17236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832329.418090:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08551c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e119a26-e2c8-49b5-8e81-f568246f48a1+16:3651:x1875726218470912:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (3697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832329.418097:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788832329.418144:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e119a26-e2c8-49b5-8e81-f568246f48a1:3654:1875726218470784:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788832329.418169:0:17267:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d2b07cfe800/0x998c12b28353829b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.418176:0:17267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d2b07cfe800/0x998c12b28353829b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832329.418181:0:17267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2b07cfe800/0x998c12b28353829b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832329.418205:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e119a26-e2c8-49b5-8e81-f568246f48a1:3651:1875726218470912:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788832329.430613:0:18008:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788832329.430664:0:18008:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788832329.430742:0:17984:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1788832329.431004:0:18009:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1788832329.431369:0:18009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788832329.433445:0:18009:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788832329.433533:0:18009:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1788832329.433819:0:17984:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1788832329.438816:0:18010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0d880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18010:1875726218471040:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788832329.438901:0:18010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832329.438973:0:18010:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0927ff00 going to sleep for 11 seconds 00000040:01000000:1.0:1788832329.439460:0:17984:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788832329.439523:0:17984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788832329.439993:0:17984:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788832329.440000:0:17984:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788832329.440042:0:17984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788832329.441025:0:17984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788832329.441562:0:17984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788832329.441592:0:17984:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788832329.441699:0:17984:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788832329.442210:0:17984:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:0.0:1788832329.443359:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218471040 00000100:00100000:0.0:1788832329.443371:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218471040 00000100:00100000:0.0:1788832329.443462:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788832329.443472:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:18010:x1875726218471040:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788832329.443666:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:18010:x1875726218471040:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 195us (4765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832329.443674:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000001:00000004:1.0:1788832329.445010:0:17984:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788832329.445159:0:18010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0d880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18010:1875726218471040:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788832329.445211:0:18010:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788832329.445256:0:18010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f37b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18010:1875726218471168:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788832329.445314:0:18010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832329.445446:0:18010:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b2480 going to sleep for 11 seconds 00000100:00100000:3.0:1788832329.445478:0:17257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218471168 00000100:00100000:3.0:1788832329.445551:0:17257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218471168 00000100:00100000:3.0:1788832329.445584:0:17257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788832329.445592:0:17257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18010:x1875726218471168:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788832329.445741:0:17257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18010:x1875726218471168:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 149us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832329.445749:0:17257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788832329.445826:0:18010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f37b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18010:1875726218471168:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788832329.445894:0:18010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f37b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:18010:1875726218471296:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788832329.445923:0:18010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832329.445949:0:18010:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788832329.446016:0:17262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218471296 00000100:00100000:1.0:1788832329.446021:0:17262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218471296 00000100:00100000:1.0:1788832329.446055:0:17262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788832329.446062:0:17262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:18010:x1875726218471296:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788832329.446112:0:17262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:18010:x1875726218471296:12345-0@lo:900:lod0001_rec0000.0 Request processed in 50us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832329.446118:0:17262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788832329.446175:0:18010:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d2b07f37b80 x1875726218471296/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788832345 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832329.446186:0:18010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f37b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:18010:1875726218471296:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788832329.446227:0:18010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f37b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18010:1875726218471424:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788832329.446253:0:18010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832329.446276:0:18010:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b2480 going to sleep for 11 seconds 00000100:00100000:1.0:1788832329.446318:0:17257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218471424 00000100:00100000:1.0:1788832329.446322:0:17257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218471424 00000100:00100000:1.0:1788832329.446340:0:17257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788832329.446346:0:17257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18010:x1875726218471424:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788832329.446405:0:17257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18010:x1875726218471424:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 58us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832329.446412:0:17257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788832329.446465:0:18010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f37b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18010:1875726218471424:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788832329.446582:0:18010:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788832329.449052:0:18010:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788832329.449134:0:18010:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788832329.449138:0:18010:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:2.0:1788832329.451783:0:17984:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788832329.451819:0:17984:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb56201793988 00100000:10000000:2.0:1788832329.451827:0:17984:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788832329.452790:0:17984:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788832329.452818:0:17984:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788832329.452847:0:17984:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788832329.452874:0:17984:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788832329.454848:0:17984:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788832329.455081:0:17984:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788832329.622769:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832330.199497:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c02c85cc0 going to sleep for 0 seconds 00000040:00080000:1.0:1788832330.455474:0:18007:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788832330.646838:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832331.223974:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c02c85cc0 going to sleep for 0 seconds 10000000:01000000:0.0:1788832331.225573:0:17247:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788832331.225579:0:17247:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d2c3fc69800 from 8 10000000:01000000:0.0:1788832331.225583:0:17247:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788832331.225656:0:17247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b2835382a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832331.225669:0:17247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b2835382a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832331.225680:0:17247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b2835382a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832331.225704:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218471552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788832331.225775:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832331.225820:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c055ea3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832331.227758:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218471552 00000100:00100000:1.0:1788832331.227844:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218471552 00000100:00100000:1.0:1788832331.227910:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788832331.227921:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+16:17247:x1875726218471552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788832331.227937:0:17244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832331.227955:0:17244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2b07cfea00/0x998c12b2835382a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b2835382a2 expref: -99 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832331.227982:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2b07cfea00/0x998c12b2835382a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b2835382a2 expref: 17 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832331.228005:0:17244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2b07cfea00/0x998c12b2835382a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835382a2 expref: 17 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832331.228014:0:17244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfea00, rc 0) 00000100:00100000:1.0:1788832331.228095:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+17:17247:x1875726218471552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (2329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832331.228102:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788832331.228780:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218471552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832331.228803:0:17247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b2835382a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835382a9 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832331.228828:0:17247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b2835382a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b2835382a9 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832331.228907:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218471680:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788832331.228962:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832331.229016:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c055ea3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832331.229041:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218471680 00000100:00100000:0.0:1788832331.229047:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218471680 00000100:00100000:0.0:1788832331.229092:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788832331.229102:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+17:17247:x1875726218471680:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788832331.229118:0:17245:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788832331.229132:0:17245:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788832331.229135:0:17245:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788832331.229232:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+17:17247:x1875726218471680:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832331.229241:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788832331.229290:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218471680:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788832331.229336:0:17247:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788832331.229344:0:17247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b2835382a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835382a9 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832331.229353:0:17247:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b2835382a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835382a9 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832331.229363:0:17247:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788832331.229366:0:17247:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d2b07d5b800 from 8 10000000:01000000:0.0:1788832331.229372:0:17247:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788832331.229395:0:17247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b2835382b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832331.229403:0:17247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b2835382b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832331.229412:0:17247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b2835382b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832331.229424:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218471808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788832331.229453:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832331.229472:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c055ea3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832331.234853:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218471808 00000100:00100000:3.0:1788832331.234877:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218471808 00000100:00100000:3.0:1788832331.234943:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788832331.234953:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+17:17247:x1875726218471808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832331.234969:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832331.234986:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c421d2400/0x998c12b2835382b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b2835382b0 expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832331.235012:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d2400/0x998c12b2835382b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b2835382b0 expref: 18 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832331.235023:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c421d2400/0x998c12b2835382b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835382b0 expref: 18 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832331.235031:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2400, rc 0) 00000100:00100000:3.0:1788832331.235106:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:17247:x1875726218471808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (5654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832331.235113:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788832331.235176:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218471808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832331.235195:0:17247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b2835382b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835382b7 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832331.235205:0:17247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b2835382b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b2835382b7 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832331.235271:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218471936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788832331.235313:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832331.235351:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c095b4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832331.235366:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218471936 00000100:00100000:3.0:1788832331.235370:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218471936 00000100:00100000:3.0:1788832331.235396:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788832331.235404:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:17247:x1875726218471936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788832331.235420:0:17244:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788832331.235435:0:17244:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788832331.235438:0:17244:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788832331.235522:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:17247:x1875726218471936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832331.235530:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788832331.235561:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218471936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788832331.236721:0:17247:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788832331.236736:0:17247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b2835382b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835382b7 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832331.236748:0:17247:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b2835382b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835382b7 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788832331.479451:0:18007:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788832331.672974:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832332.252154:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c02c85cc0 going to sleep for 0 seconds 00010000:00010000:3.0:1788832332.696966:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832333.271468:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c02c85cc0 going to sleep for 0 seconds 00000001:02000400:3.0:1788832333.708776:0:18253:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788832333.718760:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832334.301752:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c02c85cc0 going to sleep for 0 seconds 00000100:00080000:3.0:1788832334.554529:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788832334.554536:0:14992:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788832334.554540:0:14992:0:(import.c:65:import_set_state_nolock()) ffff9d2c3fd38800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788832334.554551:0:14992:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d2c3fd38800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788832334.554576:0:14992:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c3fd0c700 x1875726218472192/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788832334.554588:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788832334.554592:0:14992:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788832334.554594:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788832334.554597:0:14992:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788832334.554639:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788832334.554642:0:14992:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788832334.554645:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788832334.554648:0:14992:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788832334.554691:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218472192:0@lo:38:kworker.0 00000100:00100000:3.0:1788832334.554778:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832334.554841:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e119a26-e2c8-49b5-8e81-f568246f48a1:3652:1875726218472064:0@lo:400:kworker.0 00000100:00100000:3.0:1788832334.554883:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832334.554909:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788832334.554924:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218472576:0@lo:400:kworker.0 00000100:00100000:3.0:1788832334.554953:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832334.554983:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218472320:0@lo:400:kworker.0 00000100:00100000:3.0:1788832334.555008:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832334.555025:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788832334.555030:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218472448:0@lo:400:kworker.0 00000100:00100000:3.0:1788832334.555050:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832334.555081:0:17257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218472192 00000100:00100000:3.0:1788832334.555088:0:17257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218472192 00000100:00100000:3.0:1788832334.555112:0:17257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218472448 00000100:00100000:3.0:1788832334.555114:0:17257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218472448 00000100:00100000:3.0:1788832334.555137:0:17257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788832334.555144:0:17257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1875726218472192:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788832334.555168:0:17257:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:3.0:1788832334.555199:0:17257:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x998c12b2835382be 00000004:00100000:3.0:1788832334.555213:0:17257:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788832334.555218:0:17257:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1788832334.555286:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218472064 00000100:00100000:3.0:1788832334.555290:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218472064 00000100:00100000:3.0:1788832334.555316:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788832334.555323:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:3652:x1875726218472064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832334.555366:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:3652:x1875726218472064:12345-0@lo:400:kworker.0 Request processed in 44us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832334.555373:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788832334.555404:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218472576 00000100:00100000:3.0:1788832334.555407:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218472576 00000100:00100000:3.0:1788832334.555429:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218472320 00000100:00100000:3.0:1788832334.555437:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218472320 00000100:00100000:3.0:1788832334.555460:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788832334.555466:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218472576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832334.555496:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218472576:12345-0@lo:400:kworker.0 Request processed in 30us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832334.555501:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788832334.555512:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788832334.555518:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218472320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832334.555546:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218472320:12345-0@lo:400:kworker.0 Request processed in 29us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832334.555552:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788832334.555602:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d2c3fd0c000 x1875726218472320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832334.555615:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218472320:0@lo:400:kworker.0 00010000:00080000:3.0:1788832334.555998:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d2c3fd0e680 x1875726218472576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832334.556008:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218472576:0@lo:400:kworker.0 00000100:00100000:3.0:1788832334.556019:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e119a26-e2c8-49b5-8e81-f568246f48a1:3652:1875726218472064:0@lo:400:kworker.0 00000100:00100000:3.0:1788832334.559437:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218472704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788832334.559501:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832334.559680:0:17256:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788832334.559691:0:17256:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788832334.560864:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218472704 00000100:00100000:3.0:1788832334.560873:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218472704 00000100:00100000:1.0:1788832334.561017:0:18308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788832334.561028:0:18308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3653:x1875726218472448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832334.561109:0:18308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3653:x1875726218472448:12345-0@lo:400:kworker.0 Request processed in 82us (6056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832334.561117:0:18308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788832334.561135:0:18308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788832334.561141:0:18308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218472704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788832334.561162:0:18308:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788832334.561196:0:18308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218472704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832334.561203:0:18308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788832334.561386:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218472448:0@lo:400:kworker.0 00000100:00100000:3.0:1788832334.561423:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218472704:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788832334.561876:0:17257:0:(import.c:65:import_set_state_nolock()) ffff9d2c04db7000 : changing import state from RECOVER to FULL 00000020:00000004:0.0:1788832334.562394:0:18306:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788832334.562681:0:18306:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788832334.563111:0:17257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875726218472192:12345-0@lo:38:kworker.0 Request processed in 7963us (8330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832334.563123:0:17257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788832334.566723:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788832334.566736:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788832334.566742:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788832334.566746:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3fd38800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788832334.566809:0:3650:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c2a104fb): req@ffff9d2b0756f100 x1875726218465280/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832334.566828:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218472192:0@lo:38:kworker.0 00000100:00100000:3.0:1788832334.566923:0:17293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832334.566962:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c02c85cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832334.566989:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218465280 00000100:00100000:3.0:1788832334.566994:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218465280 00000100:00100000:3.0:1788832334.567040:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788832334.567048:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17293:x1875726218465280:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788832334.567127:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17293:x1875726218465280:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 80us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832334.567136:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788832334.567166:0:17293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17293:1875726218465280:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788832334.567201:0:17293:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788832334.567240:0:17293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17293:1875726218472832:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788832334.567270:0:17293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832334.567291:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3483fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832334.567303:0:17257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218472832 00000100:00100000:3.0:1788832334.567307:0:17257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218472832 00000100:00100000:3.0:1788832334.567328:0:17257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788832334.567334:0:17257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17293:x1875726218472832:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788832334.567441:0:17257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17293:x1875726218472832:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 106us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832334.567967:0:17257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788832334.568005:0:17293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17293:1875726218472832:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788832334.568078:0:17293:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17293:1875726218472960:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788832334.568111:0:17293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832334.568134:0:17293:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3483fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788832334.568152:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218472960 00000100:00100000:3.0:1788832334.568157:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218472960 00000100:00100000:3.0:1788832334.568178:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788832334.568185:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17293:x1875726218472960:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788832334.568237:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17293:x1875726218472960:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 52us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832334.568243:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788832334.568267:0:17293:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0e680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17293:1875726218472960:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788832334.568308:0:17293:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788832334.569916:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218473088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832334.569967:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832334.570025:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218473088 00000100:00100000:0.0:1788832334.570032:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218473088 00000100:00100000:0.0:1788832334.570071:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788832334.570079:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1875726218473088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788832334.570105:0:17256:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000040:00080000:3.0:1788832334.572459:0:17293:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788832334.572553:0:17293:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1788832334.572559:0:17293:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:0.0:1788832334.573155:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1875726218473088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3068us (3178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832334.573169:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788832334.573259:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218473088:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788832334.761517:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788832335.335547:0:18357:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788832335.336125:0:18357:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788832335.772790:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788832336.438100:0:18405:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdec0941a0 20000000:00000080:2.0:1788832336.438120:0:18405:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d2c38789c00 uarg=0000000000000000 20000000:01000000:2.0:1788832336.438161:0:18405:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788832336.438168:0:18405:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788832336.438173:0:18405:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788832336.443055:0:18406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1788832336.443243:0:18405:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788832336.456084:0:18405:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788832336.456161:0:18405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382c5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832336.456179:0:18405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2b07cfec00/0x998c12b28353816e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283538167 expref: 17 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832336.456204:0:18405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c01229600/0x998c12b283538271 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b28353826a expref: 17 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832336.456211:0:18405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382c5 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832336.456250:0:18405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c01229600/0x998c12b283538271 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b28353826a expref: 17 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832336.456264:0:18405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2c01229600/0x998c12b283538271 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b28353826a expref: 17 pid: 17245 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832336.456277:0:18405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18405:1875726218473216:0@lo:104: 00000100:00100000:3.0:1788832336.456332:0:18405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788832336.456385:0:18405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2b07cfec00/0x998c12b28353816e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283538167 expref: 17 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832336.456393:0:18405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2b07cfec00/0x998c12b28353816e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283538167 expref: 17 pid: 17244 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832336.456401:0:18405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18405:1875726218473344:0@lo:104: 00000100:00100000:3.0:1788832336.456421:0:18405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832336.456847:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218473216 00000100:00100000:1.0:1788832336.456854:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218473216 00000100:00100000:1.0:1788832336.456888:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218473344 00000100:00100000:1.0:1788832336.456890:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218473344 00000100:00100000:1.0:1788832336.456901:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788832336.456909:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e119a26-e2c8-49b5-8e81-f568246f48a1+4:18405:x1875726218473216:12345-0@lo:104: 00010000:00010000:1.0:1788832336.456920:0:17235:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2b07cff000/0x998c12b28353826a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283538271 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.456964:0:17235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788832336.456969:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e119a26-e2c8-49b5-8e81-f568246f48a1+4:18405:x1875726218473216:12345-0@lo:104: Request processed in 61us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832336.456976:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788832336.456989:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788832336.456994:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e119a26-e2c8-49b5-8e81-f568246f48a1+3:18405:x1875726218473344:12345-0@lo:104: 00010000:00010000:1.0:1788832336.457000:0:17235:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c600/0x998c12b283538167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b28353816e expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.457025:0:17235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788832336.457029:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e119a26-e2c8-49b5-8e81-f568246f48a1+3:18405:x1875726218473344:12345-0@lo:104: Request processed in 35us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832336.457034:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788832336.457049:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788832336.457055:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2b07cff000/0x998c12b28353826a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283538271 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.457062:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff000 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:1.0:1788832336.457074:0:17239:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2b07cff000/0x998c12b28353826a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283538271 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.457083:0:17239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2b07cff000/0x998c12b28353826a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283538271 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788832336.457090:0:17239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2b07cff000/0x998c12b28353826a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283538271 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832336.457096:0:17239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788832336.457123:0:17239:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2b07cff000/0x998c12b28353826a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283538271 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.457128:0:17239:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788832336.457146:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2b07cff000/0x998c12b28353826a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283538271 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.457154:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2b07cff000/0x998c12b28353826a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283538271 expref: -99 pid: 17984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.457166:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832336.457169:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c600/0x998c12b283538167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b28353816e expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.457174:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c600 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:1.0:1788832336.457177:0:17239:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c600/0x998c12b283538167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b28353816e expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.457184:0:17239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c600/0x998c12b283538167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b28353816e expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788832336.457200:0:17239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c600/0x998c12b283538167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b28353816e expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832336.457205:0:17239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788832336.457216:0:17239:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c600/0x998c12b283538167 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353816e expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.457221:0:17239:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788832336.457234:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c600/0x998c12b283538167 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353816e expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.457240:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c600/0x998c12b283538167 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353816e expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.457252:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832336.457253:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832336.457255:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832336.457271:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e119a26-e2c8-49b5-8e81-f568246f48a1:3654:1875726218473472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788832336.457297:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832336.457331:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e119a26-e2c8-49b5-8e81-f568246f48a1:3651:1875726218473600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788832336.457349:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832336.457386:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218473472 00000100:00100000:1.0:1788832336.457390:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218473472 00010000:00010000:1.0:1788832336.457405:0:17237:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c01229600/0x998c12b283538271 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b28353826a expref: 18 pid: 17245 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832336.457424:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218473600 00000100:00100000:1.0:1788832336.457427:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218473600 00010000:00010000:0.0:1788832336.457526:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832336.457700:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788832336.457711:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:3654:x1875726218473472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832336.457724:0:17238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832336.457729:0:17238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c01229600/0x998c12b283538271 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b28353826a expref: 18 pid: 17245 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832336.457746:0:17238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c01229600/0x998c12b283538271 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b28353826a expref: 18 pid: 17245 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832336.457762:0:17238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832336.457804:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08553800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:3654:x1875726218473472:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832336.457811:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788832336.457892:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e119a26-e2c8-49b5-8e81-f568246f48a1:3654:1875726218473472:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788832336.457963:0:17237:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2b07cfec00/0x998c12b28353816e lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283538167 expref: 18 pid: 17244 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832336.457990:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788832336.457997:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08553100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:3651:x1875726218473600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788832336.458006:0:17237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832336.458010:0:17237:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2b07cfec00/0x998c12b28353816e lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283538167 expref: 18 pid: 17244 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.458019:0:17237:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2b07cfec00/0x998c12b28353816e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283538167 expref: 18 pid: 17244 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.458033:0:17237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382c5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.458041:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382c5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.458054:0:17237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382c5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.458061:0:17237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382c5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.458068:0:17237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382c5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.458075:0:17237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382c5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.458080:0:17237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2c00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:1.0:1788832336.458085:0:17237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382c5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.458098:0:17237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382c5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.458105:0:17237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382c5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832336.458115:0:17237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832336.458182:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08553100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:3651:x1875726218473600:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832336.458189:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788832336.458349:0:18405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c02c85c00 going to sleep for 11 seconds 00010000:00010000:3.0:1788832336.458366:0:18405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c01229600/0x998c12b283538271 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b28353826a expref: 17 pid: 17245 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832336.458379:0:18405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18405:1875726218473216:0@lo:104: 00010000:00010000:3.0:1788832336.458389:0:18405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2b07cfec00/0x998c12b28353816e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283538167 expref: 16 pid: 17244 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832336.458410:0:18405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18405:1875726218473344:0@lo:104: 00010000:00010000:3.0:1788832336.458440:0:18405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382c5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832336.458448:0:18405:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382c5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832336.458453:0:18405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382c5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832336.458458:0:18405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382c5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832336.462086:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e119a26-e2c8-49b5-8e81-f568246f48a1:3651:1875726218473600:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788832336.794173:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788832337.310747:0:17287:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788832337.817250:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788832338.393285:0:17247:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788832338.393292:0:17247:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2c3fc69800 from 13 10000000:01000000:0.0:1788832338.393296:0:17247:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788832338.393343:0:17247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0dc00/0x998c12b2835382cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832338.393355:0:17247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0dc00/0x998c12b2835382cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832338.393366:0:17247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0dc00/0x998c12b2835382cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832338.393390:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218473728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788832338.393450:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832338.393739:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36dd4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788832338.395085:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218473728 00000100:00100000:2.0:1788832338.395096:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218473728 00000100:00100000:3.0:1788832338.398209:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788832338.398222:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+16:17247:x1875726218473728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832338.398240:0:17245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832338.398257:0:17245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b2835382cc expref: -99 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832338.398281:0:17245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b2835382cc expref: 17 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832338.398292:0:17245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835382cc expref: 17 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832338.398300:0:17245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2c00, rc 0) 00000100:00100000:3.0:1788832338.398371:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+17:17247:x1875726218473728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (4920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832338.398388:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788832338.399695:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218473728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832338.399719:0:17247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0dc00/0x998c12b2835382cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835382d3 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832338.399732:0:17247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0dc00/0x998c12b2835382cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b2835382d3 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832338.399817:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218473856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832338.399876:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832338.400372:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36dd4840 going to sleep for 11 seconds 00000100:00100000:1.0:1788832338.400462:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218473856 00000100:00100000:1.0:1788832338.400469:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218473856 00000100:00100000:1.0:1788832338.400504:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788832338.400512:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+17:17247:x1875726218473856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788832338.400693:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+17:17247:x1875726218473856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832338.400700:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788832338.400867:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218473856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832338.400901:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218473984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832338.400938:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832338.400948:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36dd4840 going to sleep for 11 seconds 00000100:00100000:1.0:1788832338.401153:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218473984 00000100:00100000:1.0:1788832338.401157:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218473984 00000100:00100000:1.0:1788832338.401176:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788832338.401183:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+17:17247:x1875726218473984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788832338.401266:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+17:17247:x1875726218473984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832338.401274:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788832338.401648:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218473984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788832338.402670:0:18515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788832338.403022:0:17247:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788832338.403044:0:17247:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788832338.403056:0:17247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0dc00/0x998c12b2835382cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835382d3 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832338.403078:0:17247:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0dc00/0x998c12b2835382cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835382d3 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832338.403088:0:17247:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788832338.403090:0:17247:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2b07d5b800 from 13 10000000:01000000:1.0:1788832338.403094:0:17247:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788832338.403128:0:17247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2b07cffe00/0x998c12b2835382da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832338.403135:0:17247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2b07cffe00/0x998c12b2835382da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832338.403145:0:17247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2b07cffe00/0x998c12b2835382da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832338.403165:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218474112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788832338.403213:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832338.403253:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c053ba900 going to sleep for 11 seconds 00000100:00100000:3.0:1788832338.403556:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218474112 00000100:00100000:3.0:1788832338.403563:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218474112 00000100:00100000:3.0:1788832338.403602:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788832338.403611:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+17:17247:x1875726218474112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832338.403641:0:17245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832338.403653:0:17245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c421d3000/0x998c12b2835382e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b2835382da expref: -99 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832338.403676:0:17245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c421d3000/0x998c12b2835382e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b2835382da expref: 18 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832338.403687:0:17245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c421d3000/0x998c12b2835382e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835382da expref: 18 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832338.403695:0:17245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d3000, rc 0) 00000100:00100000:3.0:1788832338.403737:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:17247:x1875726218474112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832338.403743:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788832338.405182:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218474112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832338.405205:0:17247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2b07cffe00/0x998c12b2835382da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835382e1 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832338.405219:0:17247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2b07cffe00/0x998c12b2835382da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b2835382e1 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832338.405295:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218474240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832338.405344:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832338.405370:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c404b0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788832338.405386:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218474240 00000100:00100000:3.0:1788832338.405390:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218474240 00000100:00100000:3.0:1788832338.405415:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788832338.405859:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:17247:x1875726218474240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832338.406009:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:17247:x1875726218474240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832338.406016:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788832338.406061:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218474240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832338.406092:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218474368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832338.406129:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832338.406144:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c404b0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788832338.406155:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218474368 00000100:00100000:3.0:1788832338.406159:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218474368 00000100:00100000:3.0:1788832338.406176:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788832338.406182:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:17247:x1875726218474368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832338.406252:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:17247:x1875726218474368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832338.406258:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788832338.406296:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218474368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788832338.411673:0:18517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788832338.413653:0:17247:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788832338.413689:0:17247:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788832338.413701:0:17247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2b07cffe00/0x998c12b2835382da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835382e1 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832338.413725:0:17247:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2b07cffe00/0x998c12b2835382da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835382e1 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832338.840493:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832339.671779:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788832329/real 1788832329] req@ffff9d2c3fd0c380 x1875726218468480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788832339 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832339.671808:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d2c3fd0c380 x1875726218468480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788832339 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832339.671830:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788832329/real 1788832329] req@ffff9d2c3fd0ed80 x1875726218468352/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788832339 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832339.671842:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d2c3fd0ed80 x1875726218468352/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788832339 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788832339.671871:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c39187000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788832339.671883:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788832339.671888:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218468480:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788832339.671893:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c054a5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788832339.671897:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788832339.671900:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218468352:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788832339.672146:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788832339.672150:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788832339.672153:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788832339.672156:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788832339.672180:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788832339.672183:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788832339.672185:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d2c054a5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788832339.672191:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 469 00000100:00080000:2.0:1788832339.672195:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788832339.672201:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9d2c054a5800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788832339.672219:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b07f34700 x1875726218475008/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788832339.672232:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788832339.672234:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788832339.672236:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d2c39187000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788832339.672239:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 469 00000100:00080000:2.0:1788832339.672241:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788832339.672244:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d2c39187000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788832339.672256:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b07f34a80 x1875726218475136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788832339.672284:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e119a26-e2c8-49b5-8e81-f568246f48a1:3652:1875726218474496:0@lo:400:kworker.0 00000100:00100000:2.0:1788832339.672346:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832339.672383:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218475264:0@lo:400:kworker.0 00000100:00100000:2.0:1788832339.672408:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832339.672429:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788832339.672434:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218474880:0@lo:400:kworker.0 00000100:00100000:2.0:1788832339.672457:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832339.672483:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875726218474752:0@lo:400:kworker.0 00000100:00100000:2.0:1788832339.672520:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832339.672537:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788832339.672543:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218474624:0@lo:400:kworker.0 00000100:00100000:2.0:1788832339.672562:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832339.672588:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218474496 00000100:00100000:2.0:1788832339.672596:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218474496 00000100:00100000:2.0:1788832339.672702:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788832339.672711:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e9e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:3652:x1875726218474496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832339.672754:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e9e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:3652:x1875726218474496:12345-0@lo:400:kworker.0 Request processed in 45us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832339.672761:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788832339.672791:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218475264 00000100:00100000:2.0:1788832339.672795:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218475264 00000100:00100000:2.0:1788832339.672830:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218474752 00000100:00100000:2.0:1788832339.672833:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218474752 00000100:00100000:2.0:1788832339.672850:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788832339.672855:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218475264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832339.672942:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218475008:0@lo:8:kworker.0 00000400:00000100:1.0:1788832339.672971:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875726218475008 offset 0 length 520: 4 00000100:00100000:1.0:1788832339.672991:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218475136:0@lo:8:kworker.0 00000400:00000100:1.0:1788832339.673007:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875726218475136 offset 0 length 520: 4 00000100:00100000:1.0:1788832339.673030:0:18308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218474880 00000100:00100000:1.0:1788832339.673034:0:18308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218474880 00000100:00100000:1.0:1788832339.673100:0:18308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218474624 00000100:00100000:1.0:1788832339.673104:0:18308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218474624 00000100:00100000:0.0:1788832339.673212:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788832339.673222:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218474880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832339.673272:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218474880:12345-0@lo:400:kworker.0 Request processed in 52us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832339.673278:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788832339.673293:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788832339.673299:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1875726218474624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832339.673333:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3654:x1875726218474624:12345-0@lo:400:kworker.0 Request processed in 34us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832339.673339:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788832339.673371:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218474624:0@lo:400:kworker.0 00000100:00100000:3.0:1788832339.674316:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218475392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832339.674407:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218475264:12345-0@lo:400:kworker.0 Request processed in 1550us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832339.674415:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788832339.674435:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788832339.674442:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875726218474752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832339.674474:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1875726218474752:12345-0@lo:400:kworker.0 Request processed in 33us (1954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832339.674479:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788832339.674663:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218474880:0@lo:400:kworker.0 00000100:00100000:2.0:1788832339.674685:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e119a26-e2c8-49b5-8e81-f568246f48a1:3652:1875726218474496:0@lo:400:kworker.0 00010000:00080000:2.0:1788832339.674698:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d2b07f36680 x1875726218475264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832339.674708:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218475264:0@lo:400:kworker.0 00000100:00100000:2.0:1788832339.674751:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218475520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788832339.674776:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788832339.674822:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d2b07f37800 x1875726218474752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832339.674832:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1875726218474752:0@lo:400:kworker.0 00000100:00100000:0.0:1788832339.674888:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218475520 00000100:00100000:0.0:1788832339.674894:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218475520 00000100:00100000:0.0:1788832339.674926:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788832339.674930:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832339.674939:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218475520:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788832339.674957:0:17257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218475392 00000100:00100000:3.0:1788832339.674960:0:17257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218475392 00000004:00000024:0.0:1788832339.674963:0:17256:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788832339.674976:0:17257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788832339.674982:0:17257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1875726218475392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788832339.674998:0:17257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788832339.674998:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218475520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832339.675004:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788832339.675032:0:17257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1875726218475392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832339.675036:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218475520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788832339.675038:0:17257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788832339.675064:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218475392:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1788832339.681820:0:17985:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788832339.867574:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832340.695269:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788832325/real 1788832325] req@ffff9d2b08550000 x1875726218466304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788832340 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832340.695306:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d2b08550000 x1875726218466304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788832340 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832340.695317:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788832325/real 1788832325] req@ffff9d2b08550700 x1875726218466432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788832340 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832340.695328:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d2b08550700 x1875726218466432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788832340 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788832340.695351:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3d6f6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788832340.695378:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788832340.695383:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218466304:0@lo:8:kworker.0 00000100:00080000:3.0:1788832340.695389:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c0aef0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788832340.695394:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788832340.695397:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218466432:0@lo:8:kworker.0 00000100:00080000:1.0:1788832340.695613:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788832340.695640:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788832340.695644:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d2c3d6f6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788832340.695649:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:1.0:1788832340.695656:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788832340.695665:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d2c3d6f6000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788832340.695692:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b08550700 x1875726218475904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788832340.695710:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788832340.695723:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788832340.695725:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d2c0aef0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788832340.695729:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:1.0:1788832340.695731:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788832340.695736:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d2c0aef0000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788832340.695750:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b08550000 x1875726218476032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788832340.695785:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788832340.695789:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788832340.695793:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788832340.695797:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788832340.695835:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218476160:0@lo:400:kworker.0 00000100:00100000:1.0:1788832340.695921:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832340.695974:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788832340.695981:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218476288:0@lo:400:kworker.0 00000100:00100000:1.0:1788832340.696017:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832340.696049:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218476160 00000100:00100000:1.0:1788832340.696058:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218476160 00000100:00100000:1.0:1788832340.696117:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788832340.696127:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218476160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832340.696194:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218476160:12345-0@lo:400:kworker.0 Request processed in 68us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832340.696202:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788832340.696232:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218475904:0@lo:8:kworker.0 00000400:00000100:1.0:1788832340.696263:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875726218475904 offset 0 length 520: 4 00000100:00100000:1.0:1788832340.696287:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218476032:0@lo:8:kworker.0 00000400:00000100:1.0:1788832340.696303:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875726218476032 offset 0 length 520: 4 00010000:00080000:1.0:1788832340.696338:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d2b08552300 x1875726218476160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832340.696351:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218476160:0@lo:400:kworker.0 00000100:00100000:0.0:1788832340.696530:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218475776:0@lo:400:kworker.0 00000100:00100000:0.0:1788832340.696567:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832340.696599:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788832340.696606:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e119a26-e2c8-49b5-8e81-f568246f48a1:3652:1875726218475648:0@lo:400:kworker.0 00000100:00100000:0.0:1788832340.696655:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832340.696674:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218476416:0@lo:400:kworker.0 00000100:00100000:0.0:1788832340.696703:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832340.696736:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218476288 00000100:00100000:0.0:1788832340.696741:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218476288 00000100:00100000:0.0:1788832340.696777:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218475776 00000100:00100000:0.0:1788832340.696781:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218475776 00000100:00100000:0.0:1788832340.696797:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788832340.696812:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218476288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832340.696857:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218476288:12345-0@lo:400:kworker.0 Request processed in 53us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832340.696864:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788832340.696878:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788832340.696885:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218475776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832340.696919:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218475776:12345-0@lo:400:kworker.0 Request processed in 35us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832340.696935:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788832340.696979:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218475648 00000100:00100000:0.0:1788832340.696984:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218475648 00000100:00100000:0.0:1788832340.697013:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788832340.697020:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e9e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:3652:x1875726218475648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832340.697052:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e9e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:3652:x1875726218475648:12345-0@lo:400:kworker.0 Request processed in 32us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832340.697058:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788832340.697090:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218476416 00000100:00100000:0.0:1788832340.697093:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218476416 00000100:00100000:0.0:1788832340.697119:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788832340.697126:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218476416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832340.697155:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218476416:12345-0@lo:400:kworker.0 Request processed in 29us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832340.697161:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788832340.697213:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e119a26-e2c8-49b5-8e81-f568246f48a1:3652:1875726218475648:0@lo:400:kworker.0 00010000:00080000:0.0:1788832340.697225:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d2b08550380 x1875726218476416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832340.697235:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218476416:0@lo:400:kworker.0 00000100:00100000:0.0:1788832340.697244:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218475776:0@lo:400:kworker.0 00000100:00100000:0.0:1788832340.697279:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218476288:0@lo:400:kworker.0 00010000:00010000:2.0:1788832340.890577:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788832341.728212:0:18007:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788832341.910749:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788832342.750714:0:18753:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788832342.750718:0:18753:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788832342.750720:0:18753:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788832342.750837:0:18753:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d2b073a5800 00000020:01000004:0.0:1788832342.750857:0:18753:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788832342.750870:0:18753:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788832342.750884:0:18753:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9d2b060099b8) 00000020:00000080:0.0:1788832342.750900:0:18753:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788832342.792442:0:18753:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788832342.793503:0:18753:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788832342.793725:0:18753:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788832342.794117:0:18753:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788832342.794332:0:18753:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788832342.794607:0:18753:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788832342.794878:0:18753:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1788832342.797349:0:18753:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788832342.797606:0:18753:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788832342.797719:0:18753:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788832342.797733:0:18753:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x998c12b2835382ef 00000020:01000004:1.0:1788832342.797741:0:18753:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788832342.797766:0:18753:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.126@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788832342.797769:0:18753:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788832342.797775:0:18753:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788832342.797779:0:18753:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788832342.797799:0:18753:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9d2c3fd199b8) 00000020:00000080:1.0:1788832342.797811:0:18753:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1788832342.805551:0:18753:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788832342.806613:0:18753:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788832342.806719:0:18753:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788832342.807887:0:18753:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788832342.807897:0:18753:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788832342.808863:0:18753:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788832342.808870:0:18753:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788832342.811850:0:18753:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788832342.812055:0:18753:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788832342.812062:0:18753:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788832342.812838:0:18753:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788832342.812848:0:18753:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788832342.841558:0:18753:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788832342.841951:0:18753:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788832342.841958:0:18753:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788832342.843314:0:18753:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788832342.843324:0:18753:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788832342.844123:0:18753:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788832342.844132:0:18753:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788832342.846057:0:18753:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788832342.846242:0:18753:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788832342.846247:0:18753:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788832342.847910:0:18753:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788832342.847923:0:18753:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788832342.880871:0:18753:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788832342.881088:0:18753:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788832342.881106:0:18753:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788832342.883169:0:18753:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788832342.883181:0:18753:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788832342.883686:0:18753:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788832342.883714:0:18753:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788832342.883720:0:18753:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788832342.893099:0:18753:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788832342.893156:0:18753:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.126@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788832342.893160:0:18753:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788832342.893162:0:18753:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788832342.893164:0:18753:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832342.893165:0:18753:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832342.893167:0:18753:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832342.893169:0:18753:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832342.893170:0:18753:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788832342.893172:0:18753:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832342.893173:0:18753:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788832342.893176:0:18753:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788832342.893179:0:18753:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788832342.893180:0:18753:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788832342.893182:0:18753:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832342.893183:0:18753:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832342.893184:0:18753:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832342.893185:0:18753:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832342.893186:0:18753:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788832342.893187:0:18753:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832342.893189:0:18753:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788832342.893214:0:18753:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788832342.893233:0:18753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218476544:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788832342.893298:0:18753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832342.893403:0:18753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0f980600 going to sleep for 11 seconds 00000100:00100000:2.0:1788832342.893488:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218476544 00000100:00100000:2.0:1788832342.893496:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218476544 00000100:00100000:2.0:1788832342.893578:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788832342.893588:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:18753:x1875726218476544:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788832342.893647:0:17244:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788832342.893651:0:17244:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788832342.893655:0:17244:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788832342.894012:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:18753:x1875726218476544:12345-0@lo:253:mount.lustre.0 Request processed in 425us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832342.894020:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788832342.894152:0:18753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218476544:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788832342.894163:0:18753:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788832342.894166:0:18753:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788832342.894167:0:18753:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788832342.894168:0:18753:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788832342.894169:0:18753:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788832342.894171:0:18753:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788832342.894172:0:18753:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788832342.894173:0:18753:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788832342.894174:0:18753:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788832342.894176:0:18753:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788832342.894195:0:18753:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d2b073a5800 from lustre-OST0000 10000000:01000000:3.0:1788832342.894237:0:18753:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788832342.894240:0:18753:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788832342.894248:0:18753:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d2b06008000 local copy 00010000:00010000:3.0:1788832342.894257:0:18753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2e00/0x998c12b2835380aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835380b1 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832342.894342:0:18753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218476672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788832342.894373:0:18753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832342.894579:0:18753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c348a1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788832342.894693:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218476672 00000100:00100000:0.0:1788832342.894698:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218476672 00000100:00100000:0.0:1788832342.894724:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788832342.894731:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:18753:x1875726218476672:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788832342.894806:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:18753:x1875726218476672:12345-0@lo:501:mount.lustre.0 Request processed in 76us (432us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788832342.894814:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788832342.894934:0:18753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218476672:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788832342.894959:0:18753:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788832342.894976:0:18753:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788832342.894982:0:18753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2e00/0x998c12b2835380aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835380b1 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832342.894991:0:18753:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2e00/0x998c12b2835380aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835380b1 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832342.895019:0:18753:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d2b073a5800 10000000:01000000:3.0:1788832342.895024:0:18753:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788832342.895028:0:18753:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788832342.895031:0:18753:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788832342.895034:0:18753:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788832342.895038:0:18753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788832342.895057:0:18753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835382fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832342.895065:0:18753:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835382fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832342.895075:0:18753:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835382fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832342.895088:0:18753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218476800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788832342.895112:0:18753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832342.895138:0:18753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c348a1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788832342.895188:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218476800 00000100:00100000:0.0:1788832342.895193:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218476800 00000100:00100000:0.0:1788832342.895211:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788832342.895216:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+18:18753:x1875726218476800:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788832342.895225:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832342.895236:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c1fe0c800/0x998c12b283538304 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b2835382fd expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832342.895256:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c1fe0c800/0x998c12b283538304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b2835382fd expref: 19 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832342.895266:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c1fe0c800/0x998c12b283538304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835382fd expref: 19 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832342.895274:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0c800, rc 0) 00000100:00100000:0.0:1788832342.895312:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+19:18753:x1875726218476800:12345-0@lo:101:mount.lustre.0 Request processed in 94us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832342.895318:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788832342.895380:0:18753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218476800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788832342.895401:0:18753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835382fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538304 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832342.895416:0:18753:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835382fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283538304 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788832342.896520:0:18753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788832342.897178:0:18753:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788832342.899155:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788832342.899199:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788832342.899213:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788832342.899225:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788832342.899236:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788832342.899249:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788832342.899270:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788832342.899276:0:18753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788832342.899371:0:18753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218476928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788832342.899679:0:18753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832342.899891:0:18753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c348a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832342.899988:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218476928 00000100:00100000:1.0:1788832342.899996:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218476928 00000100:00100000:2.0:1788832342.900058:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788832342.900078:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04ddb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+19:18753:x1875726218476928:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788832342.900236:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04ddb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+19:18753:x1875726218476928:12345-0@lo:501:mount.lustre.0 Request processed in 160us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832342.900244:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788832342.900332:0:18753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218476928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788832342.900365:0:18753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218477056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788832342.900412:0:18753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832342.900433:0:18753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c348a13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832342.900475:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218477056 00000100:00100000:0.0:1788832342.900479:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218477056 00000100:00100000:0.0:1788832342.900511:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788832342.900518:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+19:18753:x1875726218477056:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788832342.901259:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+19:18753:x1875726218477056:12345-0@lo:503:mount.lustre.0 Request processed in 739us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832342.901267:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788832342.901343:0:18753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218477056:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788832342.901755:0:18753:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788832342.901829:0:18753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218477184:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788832342.901870:0:18753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832342.901957:0:18753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c348a1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788832342.902146:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218477184 00000100:00100000:1.0:1788832342.902152:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218477184 00000100:00100000:0.0:1788832342.902200:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788832342.902208:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04ddbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+19:18753:x1875726218477184:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788832342.902570:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04ddbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+19:18753:x1875726218477184:12345-0@lo:502:mount.lustre.0 Request processed in 363us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832342.902578:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788832342.902702:0:18753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218477184:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788832342.902896:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788832342.902922:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788832342.902952:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788832342.902967:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788832342.902977:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788832342.902989:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788832342.903001:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788832342.903014:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788832342.903026:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788832342.903038:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788832342.903050:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788832342.903061:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788832342.903088:0:18753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218477312:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788832342.903127:0:18753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832342.903151:0:18753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c348a1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788832342.903210:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218477312 00000100:00100000:2.0:1788832342.903215:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218477312 00000100:00100000:2.0:1788832342.903255:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788832342.903262:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04ddb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+19:18753:x1875726218477312:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788832342.903349:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04ddb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+19:18753:x1875726218477312:12345-0@lo:502:mount.lustre.0 Request processed in 87us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832342.903355:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788832342.903519:0:18753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218477312:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788832342.903556:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788832342.903565:0:18753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1788832342.904345:0:18770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788832342.904353:0:18770:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788832342.904359:0:18770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788832342.904361:0:18770:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788832342.904367:0:18770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788832342.904457:0:18770:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9d2b06170000) 00000020:00000080:2.0:1788832342.904490:0:18770:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788832342.904497:0:18770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788832342.904572:0:18770:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d2b073a5800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788832342.904581:0:18770:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788832342.904588:0:18770:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x998c12b283538312 00010000:00010000:3.0:1788832342.910243:0:18770:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788832342.910884:0:18770:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967326 00080000:10000000:3.0:1788832342.912145:0:18770:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1788832342.913332:0:18770:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788832342.913342:0:18770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832342.913349:0:18770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832342.913352:0:18770:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788832342.913355:0:18770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788832342.913358:0:18770:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1788832342.913360:0:18770:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788832342.913361:0:18770:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788832342.913363:0:18770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788832342.913365:0:18770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832342.913367:0:18770:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788832342.913375:0:18770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832342.913378:0:18770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832342.913380:0:18770:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788832342.913383:0:18770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788832342.913385:0:18770:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788832342.913399:0:18770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832342.913401:0:18770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832342.913403:0:18770:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788832342.913406:0:18770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832342.913408:0:18770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832342.913410:0:18770:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788832342.913413:0:18770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788832342.913439:0:18770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832342.913441:0:18770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832342.913443:0:18770:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788832342.913446:0:18770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788832342.917444:0:18753:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788832342.917493:0:18753:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788832342.917554:0:18753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835382fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538304 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832342.917568:0:18753:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2000/0x998c12b2835382fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538304 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832342.917589:0:18753:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2b073a5800 from 1 10000000:01000000:2.0:1788832342.917592:0:18753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788832342.917650:0:18753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c01229a00/0x998c12b283538319 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832342.917659:0:18753:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c01229a00/0x998c12b283538319 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832342.917669:0:18753:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c01229a00/0x998c12b283538319 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832342.917693:0:18753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218477440:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788832342.917755:0:18753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832342.917803:0:18753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832342.917884:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218477440 00000100:00100000:1.0:1788832342.917892:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218477440 00000100:00100000:1.0:1788832342.917941:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788832342.917951:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04ddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+19:18753:x1875726218477440:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788832342.917964:0:17244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832342.917977:0:17244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2b07cfe000/0x998c12b283538320 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283538319 expref: -99 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.917999:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2b07cfe000/0x998c12b283538320 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283538319 expref: 20 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.918010:0:17244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2b07cfe000/0x998c12b283538320 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283538319 expref: 20 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.918018:0:17244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe000, rc 0) 00000100:00100000:1.0:1788832342.918056:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04ddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+20:18753:x1875726218477440:12345-0@lo:101:mount.lustre.0 Request processed in 107us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832342.918069:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788832342.918160:0:18753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218477440:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788832342.918174:0:18753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c01229a00/0x998c12b283538319 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538320 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832342.918182:0:18753:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c01229a00/0x998c12b283538319 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283538320 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788832342.919136:0:18753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788832342.919363:0:18753:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788832342.919592:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788832342.919616:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788832342.920288:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788832342.920294:0:18753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788832342.920361:0:18753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218477568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788832342.921603:0:18753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832342.921713:0:18753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788832342.923514:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218477568 00000100:00100000:3.0:1788832342.923525:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218477568 00000100:00100000:3.0:1788832342.923604:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788832342.923614:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+20:18753:x1875726218477568:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788832342.923832:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+20:18753:x1875726218477568:12345-0@lo:501:mount.lustre.0 Request processed in 218us (2230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832342.923839:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788832342.923936:0:18753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218477568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788832342.923985:0:18753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218477696:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788832342.924033:0:18753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832342.924350:0:18753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f5600 going to sleep for 11 seconds 00000100:00100000:1.0:1788832342.924394:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218477696 00000100:00100000:1.0:1788832342.924399:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218477696 00000100:00100000:0.0:1788832342.924443:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788832342.924453:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+20:18753:x1875726218477696:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788832342.924550:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+20:18753:x1875726218477696:12345-0@lo:503:mount.lustre.0 Request processed in 98us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832342.924558:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788832342.924722:0:18753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218477696:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788832342.925232:0:18753:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788832342.925306:0:18753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218477824:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788832342.925342:0:18753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832342.925429:0:18753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788832342.925452:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218477824 00000100:00100000:3.0:1788832342.925457:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218477824 00000100:00100000:3.0:1788832342.925494:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788832342.925503:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+20:18753:x1875726218477824:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788832342.925606:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+20:18753:x1875726218477824:12345-0@lo:502:mount.lustre.0 Request processed in 103us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832342.925614:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788832342.925708:0:18753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218477824:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788832342.926042:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788832342.926070:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788832342.926083:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788832342.926095:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788832342.926109:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788832342.926122:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788832342.926135:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788832342.926148:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788832342.926162:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788832342.926176:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788832342.926188:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788832342.926211:0:18753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218477952:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788832342.926249:0:18753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832342.926281:0:18753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c050f50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832342.926353:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218477952 00000100:00100000:0.0:1788832342.926358:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218477952 00000100:00100000:0.0:1788832342.926424:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788832342.926432:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+20:18753:x1875726218477952:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788832342.926528:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+20:18753:x1875726218477952:12345-0@lo:502:mount.lustre.0 Request processed in 97us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832342.926536:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788832342.926599:0:18753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218477952:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788832342.926664:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788832342.926672:0:18753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788832342.928074:0:18774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832342.928086:0:18774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832342.928089:0:18774:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788832342.928106:0:18774:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d2b073a5800 00000020:00000080:0.0:1788832342.928110:0:18774:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788832342.928118:0:18774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832342.928125:0:18774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832342.928127:0:18774:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788832342.928130:0:18774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832342.928133:0:18774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832342.928134:0:18774:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788832342.928137:0:18774:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d2b073a5800 00000020:00000080:0.0:1788832342.928139:0:18774:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788832342.928226:0:18774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832342.928230:0:18774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832342.928232:0:18774:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788832342.928234:0:18774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832342.928237:0:18774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832342.928238:0:18774:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788832342.928241:0:18774:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d2b073a5800 00000020:00000080:0.0:1788832342.928243:0:18774:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788832342.928782:0:18774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832342.928787:0:18774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832342.928799:0:18774:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788832342.928803:0:18774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788832342.928805:0:18774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832342.928806:0:18774:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788832342.928810:0:18774:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d2b073a5800 00000020:00000080:0.0:1788832342.928812:0:18774:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788832342.928843:0:18774:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788832342.928847:0:18774:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788832342.928848:0:18774:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788832342.928851:0:18774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1788832342.929589:0:18753:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788832342.929616:0:18753:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788832342.929658:0:18753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c01229a00/0x998c12b283538319 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538320 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832342.929671:0:18753:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c01229a00/0x998c12b283538319 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538320 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832342.929724:0:18753:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788832342.929727:0:18753:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d2b073a5800 10000000:01000000:3.0:1788832342.929730:0:18753:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d2b073a5800 10000000:01000000:3.0:1788832342.929736:0:18753:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788832342.929741:0:18753:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d2b073a5800 from 1 10000000:01000000:3.0:1788832342.929744:0:18753:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788832342.929798:0:18753:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538327 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832342.929807:0:18753:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538327 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832342.929817:0:18753:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538327 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832342.929849:0:18753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218478080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788832342.929911:0:18753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832342.929959:0:18753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c358c2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788832342.930105:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218478080 00000100:00100000:1.0:1788832342.930112:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218478080 00000100:00100000:1.0:1788832342.930163:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788832342.930188:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+20:18753:x1875726218478080:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788832342.930201:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832342.930244:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2b07cffc00/0x998c12b28353832e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283538327 expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.930266:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2b07cffc00/0x998c12b28353832e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283538327 expref: 21 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.930275:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2b07cffc00/0x998c12b28353832e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283538327 expref: 21 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.930283:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cffc00, rc 0) 00000100:00100000:1.0:1788832342.930324:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:18753:x1875726218478080:12345-0@lo:101:mount.lustre.0 Request processed in 140us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832342.930330:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788832342.930394:0:18753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218478080:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788832342.930408:0:18753:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538327 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353832e expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832342.930417:0:18753:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538327 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b28353832e expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788832342.933496:0:18753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788832342.933778:0:18753:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788832342.933966:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788832342.933987:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788832342.933999:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788832342.934009:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788832342.934020:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788832342.934030:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788832342.934041:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788832342.934067:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788832342.934082:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788832342.934094:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788832342.934107:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788832342.934118:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788832342.934128:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788832342.934140:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788832342.934151:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788832342.934163:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788832342.934176:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788832342.934188:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788832342.934199:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788832342.934209:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788832342.934220:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788832342.934230:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788832342.934241:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788832342.934263:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788832342.934274:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788832342.934285:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788832342.934295:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788832342.934305:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788832342.934315:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788832342.934333:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788832342.934343:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788832342.934354:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788832342.934364:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788832342.934374:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788832342.934384:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788832342.934406:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788832342.934418:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788832342.934432:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788832342.934436:0:18753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788832342.934507:0:18753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218478208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788832342.934563:0:18753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832342.934605:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218478208 00000100:00100000:0.0:1788832342.934611:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218478208 00000100:00100000:0.0:1788832342.934666:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788832342.934674:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:18753:x1875726218478208:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788832342.934759:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:18753:x1875726218478208:12345-0@lo:501:mount.lustre.0 Request processed in 85us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832342.934766:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788832342.934816:0:18753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0322e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832342.934835:0:18753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218478208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788832342.934860:0:18753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218478336:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788832342.934894:0:18753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832342.934907:0:18753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0322e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832342.935543:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218478336 00000100:00100000:1.0:1788832342.935549:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218478336 00000100:00100000:1.0:1788832342.935591:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788832342.935599:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:18753:x1875726218478336:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788832342.935720:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:18753:x1875726218478336:12345-0@lo:503:mount.lustre.0 Request processed in 121us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832342.935727:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00010000:1.0:1788832342.935805:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832342.935880:0:18753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218478336:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788832342.936785:0:18753:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788832342.936883:0:18753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218478464:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788832342.936939:0:18753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832342.936974:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218478464 00000100:00100000:0.0:1788832342.936978:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218478464 00000100:00100000:0.0:1788832342.937013:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788832342.937021:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:18753:x1875726218478464:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788832342.937520:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:18753:x1875726218478464:12345-0@lo:502:mount.lustre.0 Request processed in 498us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832342.937528:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788832342.937582:0:18753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0322ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788832342.937600:0:18753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218478464:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788832342.937891:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788832342.937919:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788832342.937933:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788832342.937944:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788832342.937958:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788832342.937972:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788832342.937985:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788832342.937997:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788832342.938011:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788832342.938024:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788832342.938111:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788832342.938131:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788832342.938150:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788832342.938164:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788832342.938191:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788832342.938206:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788832342.938219:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788832342.938231:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788832342.938244:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788832342.938266:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788832342.938279:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788832342.938292:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788832342.938304:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788832342.938316:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788832342.938327:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788832342.938340:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788832342.938351:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788832342.938363:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788832342.938375:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788832342.938387:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788832342.938413:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788832342.938428:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788832342.938440:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788832342.938452:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788832342.938610:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1788832342.939565:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1788832342.939587:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1788832342.939600:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1788832342.939612:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1788832342.939699:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1788832342.939715:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1788832342.939728:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1788832342.939740:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1788832342.939752:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1788832342.939764:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1788832342.939775:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1788832342.939787:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1788832342.939813:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1788832342.939865:0:18753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218478592:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788832342.939930:0:18753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832342.940012:0:18753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c053ba6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832342.945161:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218478592 00000100:00100000:0.0:1788832342.945176:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218478592 00000100:00100000:0.0:1788832342.945231:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788832342.945241:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:18753:x1875726218478592:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788832342.945412:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:18753:x1875726218478592:12345-0@lo:502:mount.lustre.0 Request processed in 171us (5481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832342.945419:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788832342.945595:0:18753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218478592:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788832342.950948:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1788832342.950981:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1788832342.951029:0:18753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218478720:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788832342.951111:0:18753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832342.951149:0:18753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c053ba6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832342.951173:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218478720 00000100:00100000:1.0:1788832342.951179:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218478720 00000100:00100000:1.0:1788832342.951224:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788832342.951231:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:18753:x1875726218478720:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788832342.951338:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:18753:x1875726218478720:12345-0@lo:502:mount.lustre.0 Request processed in 106us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832342.951355:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788832342.951411:0:18753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218478720:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788832342.951448:0:18753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1788832342.951456:0:18753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788832342.953019:0:18779:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788832342.953046:0:18779:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9d2b06398000) 00000020:00000080:1.0:1788832342.953071:0:18779:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788832342.953169:0:18779:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d2b073a5800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788832342.953174:0:18779:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d2b073a5800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788832342.953176:0:18779:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d2b073a5800 3 00010000:00080000:1.0:1788832342.953206:0:18779:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2b06010800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.126@tcp at head 00010000:00010000:1.0:1788832342.955374:0:18779:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788832342.955734:0:18779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788832342.955775:0:18779:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788832342.955800:0:18779:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x998c12b28353833c 00000100:00080000:1.0:1788832342.955810:0:18779:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788832342.955816:0:18779:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d2b06010800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788832342.955856:0:18779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b08552300 x1875726218478848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788832342.955890:0:18779:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788832342.955920:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1875726218478848:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788832342.955939:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788832342.955943:0:14992:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788832342.955945:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788832342.955948:0:14992:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788832342.955971:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788832342.955980:0:14992:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788832342.955982:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788832342.955985:0:14992:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788832342.955992:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832342.956116:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218478976:0@lo:400:kworker.0 00000100:00100000:0.0:1788832342.956145:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1788832342.956147:0:18779:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788832342.956159:0:18779:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9d2b063999b8) 00000100:00100000:0.0:1788832342.956164:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788832342.956170:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218479360:0@lo:400:kworker.0 00000020:00000080:1.0:1788832342.956172:0:18779:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000100:00100000:0.0:1788832342.956197:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832342.956225:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218479104:0@lo:400:kworker.0 00000020:01000004:1.0:1788832342.956231:0:18779:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d2b073a5800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788832342.956234:0:18779:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d2b073a5800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788832342.956237:0:18779:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d2b073a5800 3 00000100:00100000:0.0:1788832342.956245:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832342.956261:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00080000:1.0:1788832342.956264:0:18779:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2b06011000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.126@tcp at head 00000100:00100000:0.0:1788832342.956265:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218479232:0@lo:400:kworker.0 00000100:00100000:0.0:1788832342.956285:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832342.956329:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218478848 00000100:00100000:0.0:1788832342.956336:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218478848 00000100:00100000:0.0:1788832342.956359:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218479360 00000100:00100000:0.0:1788832342.956361:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218479360 00000100:00100000:0.0:1788832342.956380:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218479104 00000100:00100000:0.0:1788832342.956383:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218479104 00000100:00100000:0.0:1788832342.956396:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788832342.956405:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218479360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832342.956453:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218479360:12345-0@lo:400:kworker.0 Request processed in 49us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832342.957412:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788832342.957440:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788832342.957451:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218479104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832342.958251:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218479104:12345-0@lo:400:kworker.0 Request processed in 800us (2000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832342.958260:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788832342.958280:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788832342.958285:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1875726218478848:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788832342.958308:0:17253:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:0.0:1788832342.958350:0:17253:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x998c12b28353834a 00000004:00100000:0.0:1788832342.958370:0:17253:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788832342.958402:0:17253:0:(import.c:65:import_set_state_nolock()) ffff9d2b0851c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788832342.958444:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875726218478848:12345-0@lo:38:llog_process_th.0 Request processed in 157us (2451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832342.958451:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788832342.958739:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218478976 00000100:00100000:0.0:1788832342.958746:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218478976 00000100:00100000:0.0:1788832342.958774:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218479232 00000100:00100000:0.0:1788832342.958776:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218479232 00000100:00100000:0.0:1788832342.958798:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788832342.958806:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218478976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832342.958842:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218478976:12345-0@lo:400:kworker.0 Request processed in 38us (2696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832342.958848:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788832342.958859:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788832342.958864:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218479232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832342.958889:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218479232:12345-0@lo:400:kworker.0 Request processed in 25us (2603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832342.958894:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788832342.958926:0:18779:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000100:00100000:0.0:1788832342.958958:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218479232:0@lo:400:kworker.0 00010000:00080000:0.0:1788832342.959532:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b08553b80 x1875726218479104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832342.959548:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218479104:0@lo:400:kworker.0 00010000:00080000:0.0:1788832342.959593:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b08552a00 x1875726218479360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832342.959603:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218479360:0@lo:400:kworker.0 00000100:00100000:0.0:1788832342.959710:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218478976:0@lo:400:kworker.0 00010000:00080000:0.0:1788832342.959744:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b08552300 x1875726218478848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788832352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832342.959754:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788832342.959761:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788832342.959768:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788832342.959772:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788832342.959776:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2b06010800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788832342.959782:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1875726218478848:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1788832342.961662:0:18779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788832342.963224:0:18779:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788832342.963239:0:18779:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x998c12b283538351 00000100:00080000:1.0:1788832342.963250:0:18779:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788832342.963257:0:18779:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9d2b06011000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:1.0:1788832342.963292:0:18779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b08552300 x1875726218479488/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788832342.963333:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1875726218479488:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788832342.963464:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832342.963526:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218479488 00000100:00100000:1.0:1788832342.963533:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218479488 00000100:00100000:1.0:1788832342.963563:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788832342.963570:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1875726218479488:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788832342.963596:0:17253:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:1.0:1788832342.963653:0:17253:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x998c12b283538358 00000004:00100000:1.0:1788832342.963674:0:17253:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788832342.964153:0:17253:0:(import.c:65:import_set_state_nolock()) ffff9d2b06014000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788832342.964212:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875726218479488:12345-0@lo:38:llog_process_th.0 Request processed in 640us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832342.964220:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788832342.964243:0:18779:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788832342.964301:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788832342.964305:0:14992:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788832342.964308:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788832342.964311:0:14992:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788832342.964325:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788832342.964328:0:14992:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788832342.964330:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788832342.964333:0:14992:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788832342.964358:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218479744:0@lo:400:kworker.0 00000100:00100000:3.0:1788832342.964472:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218480000:0@lo:400:kworker.0 00010000:00080000:3.0:1788832342.964521:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b08552300 x1875726218479488/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788832352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832342.964532:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788832342.964539:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788832342.964546:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788832342.964551:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788832342.964553:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2b06011000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788832342.964559:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1875726218479488:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788832342.964602:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832342.964652:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218480256:0@lo:400:kworker.0 00000100:00100000:1.0:1788832342.964678:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832342.964765:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788832342.964771:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218479872:0@lo:400:kworker.0 00000100:00100000:3.0:1788832342.964964:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218479744 00000100:00100000:3.0:1788832342.964970:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218479744 00000100:00100000:3.0:1788832342.965002:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788832342.965010:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218479744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832342.965051:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218479744:12345-0@lo:400:kworker.0 Request processed in 42us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832342.965057:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788832342.965094:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832342.965113:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788832342.965120:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e119a26-e2c8-49b5-8e81-f568246f48a1:3651:1875726218479616:0@lo:400:kworker.0 00000100:00100000:3.0:1788832342.965146:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832342.965161:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218480128:0@lo:400:kworker.0 00000100:00100000:3.0:1788832342.965192:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832342.965219:0:18308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218480000 00000100:00100000:3.0:1788832342.965223:0:18308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218480000 00000100:00100000:3.0:1788832342.965243:0:18308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788832342.965248:0:18308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218480000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832342.965280:0:18308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218480000:12345-0@lo:400:kworker.0 Request processed in 32us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832342.965286:0:18308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788832342.965302:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218479616 00000100:00100000:3.0:1788832342.965305:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218479616 00000100:00100000:3.0:1788832342.965327:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788832342.965333:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:3651:x1875726218479616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832342.965360:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:3651:x1875726218479616:12345-0@lo:400:kworker.0 Request processed in 27us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832342.965366:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788832342.965913:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832342.965945:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218479744:0@lo:400:kworker.0 00000100:00100000:1.0:1788832342.965973:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218480256 00000100:00100000:1.0:1788832342.965984:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218480256 00000100:00100000:1.0:1788832342.966020:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218480128 00000100:00100000:1.0:1788832342.966023:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218480128 00000100:00100000:1.0:1788832342.966035:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218479872 00000100:00100000:1.0:1788832342.966037:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218479872 00000100:00100000:1.0:1788832342.966050:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788832342.966056:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218480256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832342.966090:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218480256:12345-0@lo:400:kworker.0 Request processed in 34us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832342.966096:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788832342.966106:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788832342.966111:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218480128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832342.966136:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218480128:12345-0@lo:400:kworker.0 Request processed in 25us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832342.966141:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788832342.966149:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788832342.966153:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218479872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832342.966172:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218479872:12345-0@lo:400:kworker.0 Request processed in 18us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832342.966176:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788832342.966200:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788832342.966220:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b08550380 x1875726218479872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832342.966229:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218479872:0@lo:400:kworker.0 00010000:00080000:1.0:1788832342.966238:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b0771df80 x1875726218480256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832342.966256:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218480256:0@lo:400:kworker.0 00000100:00100000:3.0:1788832342.967333:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e119a26-e2c8-49b5-8e81-f568246f48a1:3651:1875726218479616:0@lo:400:kworker.0 00010000:00080000:3.0:1788832342.967348:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b0771c700 x1875726218480128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832342.967357:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218480128:0@lo:400:kworker.0 00000100:00100000:3.0:1788832342.967367:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218480000:0@lo:400:kworker.0 00000040:00080000:1.0:1788832342.967666:0:18779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1788832342.968684:0:18753:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788832342.968727:0:18753:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788832342.968746:0:18753:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538327 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353832e expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832342.968773:0:18753:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2200/0x998c12b283538327 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353832e expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788832342.968834:0:18753:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788832342.968836:0:18753:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788832342.968837:0:18753:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788832342.968839:0:18753:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788832342.968840:0:18753:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788832342.968841:0:18753:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788832342.968843:0:18753:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788832342.968845:0:18753:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788832342.968846:0:18753:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788832342.968850:0:18753:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788832342.968852:0:18753:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788832342.968854:0:18753:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788832342.968855:0:18753:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788832342.968856:0:18753:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788832342.968857:0:18753:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788832342.968858:0:18753:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788832342.968859:0:18753:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788832342.968860:0:18753:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788832342.968861:0:18753:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788832342.968885:0:18753:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788832342.968902:0:18753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218480384:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788832342.968957:0:18753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832342.968987:0:18753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c358c26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832342.969130:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218480384 00000100:00100000:1.0:1788832342.969138:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218480384 00000100:00100000:1.0:1788832342.969186:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788832342.969195:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:18753:x1875726218480384:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788832342.969219:0:17245:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788832342.969232:0:17245:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788832342.971757:0:17245:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788832342.971814:0:17245:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788832342.972600:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:18753:x1875726218480384:12345-0@lo:253:mount.lustre.0 Request processed in 3402us (3637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832342.972612:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 20000000:01000000:1.0:1788832342.972765:0:17267:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788832342.972770:0:17267:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788832342.972797:0:17267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d2b07cffa00/0x998c12b28353835f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.972813:0:17267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2b07cfea00/0x998c12b2835382a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835382a2 expref: 20 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.972821:0:17267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c421d2400/0x998c12b2835382b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835382b0 expref: 20 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.972829:0:17267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d2b07cffa00/0x998c12b28353835f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.972864:0:17267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c421d2400/0x998c12b2835382b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b2835382b0 expref: 20 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.972879:0:17267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2c421d2400/0x998c12b2835382b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b2835382b0 expref: 20 pid: 17243 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832342.972892:0:17267:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17267:1875726218480512:0@lo:104: 00000100:00100000:1.0:1788832342.972931:0:17267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788832342.972970:0:17267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2b07cfea00/0x998c12b2835382a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b2835382a2 expref: 20 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.972979:0:17267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2b07cfea00/0x998c12b2835382a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b2835382a2 expref: 20 pid: 17244 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832342.972987:0:17267:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17267:1875726218480640:0@lo:104: 00000100:00100000:1.0:1788832342.973008:0:17267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832342.973024:0:17267:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c11fca240 going to sleep for 11 seconds 00000100:00100000:1.0:1788832342.973046:0:17234:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788832342.973058:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218480512 00000100:00100000:1.0:1788832342.973064:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218480512 00000100:00100000:1.0:1788832342.973090:0:17234:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218480640 00000100:00100000:1.0:1788832342.973093:0:17234:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218480640 00000100:00100000:1.0:1788832342.973105:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788832342.973112:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e119a26-e2c8-49b5-8e81-f568246f48a1+4:17267:x1875726218480512:12345-0@lo:104: 00010000:00010000:1.0:1788832342.973123:0:17234:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b2835382b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b2835382b7 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.973161:0:17234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788832342.973166:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e119a26-e2c8-49b5-8e81-f568246f48a1+4:17267:x1875726218480512:12345-0@lo:104: Request processed in 55us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832342.973172:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788832342.973183:0:17234:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788832342.973189:0:17234:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e9e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e119a26-e2c8-49b5-8e81-f568246f48a1+3:17267:x1875726218480640:12345-0@lo:104: 00010000:00010000:1.0:1788832342.973196:0:17234:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b2835382a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b2835382a9 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.973234:0:17234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788832342.973239:0:17234:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e9e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e119a26-e2c8-49b5-8e81-f568246f48a1+3:17267:x1875726218480640:12345-0@lo:104: Request processed in 51us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832342.973245:0:17234:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788832342.973282:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788832342.973288:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b2835382b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b2835382b7 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.973295:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0da00 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:1.0:1788832342.973299:0:17240:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b2835382b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b2835382b7 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.973309:0:17240:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b2835382b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b2835382b7 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788832342.973316:0:17240:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b2835382b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b2835382b7 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832342.973322:0:17240:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788832342.973346:0:17240:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b2835382b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835382b7 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.973352:0:17240:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788832342.973370:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b2835382b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835382b7 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.973377:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0da00/0x998c12b2835382b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835382b7 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.973526:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832342.973530:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b2835382a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b2835382a9 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.973536:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0ce00 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:1.0:1788832342.973540:0:17240:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b2835382a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b2835382a9 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.973547:0:17240:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b2835382a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b2835382a9 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788832342.973554:0:17240:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b2835382a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b2835382a9 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832342.973560:0:17240:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788832342.973574:0:17240:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b2835382a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835382a9 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.973580:0:17240:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788832342.973596:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b2835382a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835382a9 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.973603:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b2835382a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835382a9 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.973615:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832342.973617:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832342.973634:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832342.973641:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832342.973658:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e119a26-e2c8-49b5-8e81-f568246f48a1:3654:1875726218480768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788832342.973685:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832342.973779:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788832342.973787:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e119a26-e2c8-49b5-8e81-f568246f48a1:3652:1875726218480896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788832342.973860:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832342.973887:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218480768 00000100:00100000:1.0:1788832342.973891:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218480768 00010000:00010000:1.0:1788832342.973907:0:17236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c421d2400/0x998c12b2835382b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b2835382b0 expref: 21 pid: 17243 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832342.973925:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218480896 00000100:00100000:1.0:1788832342.973928:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218480896 00010000:00010000:1.0:1788832342.973936:0:17236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2b07cfea00/0x998c12b2835382a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b2835382a2 expref: 22 pid: 17244 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832342.973949:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788832342.973954:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e119a26-e2c8-49b5-8e81-f568246f48a1+22:3654:x1875726218480768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788832342.973963:0:17236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832342.973967:0:17236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c421d2400/0x998c12b2835382b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b2835382b0 expref: 22 pid: 17243 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.973977:0:17236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c421d2400/0x998c12b2835382b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b2835382b0 expref: 22 pid: 17243 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.973992:0:17236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832342.974016:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e119a26-e2c8-49b5-8e81-f568246f48a1+22:3654:x1875726218480768:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832342.974023:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788832342.974034:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788832342.974040:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c420cec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:3652:x1875726218480896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788832342.974053:0:17236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832342.974058:0:17236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2b07cfea00/0x998c12b2835382a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b2835382a2 expref: 21 pid: 17244 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.974067:0:17236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2b07cfea00/0x998c12b2835382a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b2835382a2 expref: 21 pid: 17244 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.974079:0:17236:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d2b07cffa00/0x998c12b28353835f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.974087:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2b07cffa00/0x998c12b28353835f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788832342.974099:0:17236:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004822926s 00010000:00010000:1.0:1788832342.974104:0:17236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2b07cffa00/0x998c12b28353835f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.974111:0:17236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2b07cffa00/0x998c12b28353835f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.974117:0:17236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d2b07cffa00/0x998c12b28353835f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.974124:0:17236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d2b07cffa00/0x998c12b28353835f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.974130:0:17236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cffa00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:1.0:1788832342.974135:0:17236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d2b07cffa00/0x998c12b28353835f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.974143:0:17236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d2b07cffa00/0x998c12b28353835f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.974157:0:17236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d2b07cffa00/0x998c12b28353835f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.974166:0:17236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832342.974190:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c420cec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:3652:x1875726218480896:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832342.974197:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788832342.974257:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e119a26-e2c8-49b5-8e81-f568246f48a1:3652:1875726218480896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788832342.974282:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e119a26-e2c8-49b5-8e81-f568246f48a1:3654:1875726218480768:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788832342.974299:0:17267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c421d2400/0x998c12b2835382b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b2835382b0 expref: 20 pid: 17243 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832342.974310:0:17267:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17267:1875726218480512:0@lo:104: 00010000:00010000:1.0:1788832342.974318:0:17267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2b07cfea00/0x998c12b2835382a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b2835382a2 expref: 19 pid: 17244 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832342.974325:0:17267:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17267:1875726218480640:0@lo:104: 00010000:00010000:1.0:1788832342.974337:0:17267:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d2b07cffa00/0x998c12b28353835f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.974346:0:17267:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d2b07cffa00/0x998c12b28353835f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.974352:0:17267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d2b07cffa00/0x998c12b28353835f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832342.974357:0:17267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2b07cffa00/0x998c12b28353835f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832342.974919:0:18753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:18753:1875726218480384:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788832342.974941:0:18753:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788832342.974944:0:18753:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788832342.974946:0:18753:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788832342.974947:0:18753:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788832342.974948:0:18753:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788832342.974949:0:18753:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788832342.974950:0:18753:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788832342.974952:0:18753:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788832342.974953:0:18753:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788832342.974955:0:18753:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788832342.974968:0:18753:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1788832342.984353:0:18753:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788832342.992719:0:18753:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788832342.992729:0:18753:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788832342.992781:0:18753:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788832342.992831:0:18753:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788832342.992848:0:18753:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788832342.992873:0:18753:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788832342.993488:0:18753:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788832342.994865:0:18753:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1788832343.856739:0:18833:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788832343.856929:0:18833:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788832343.958765:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788832344.609937:0:17247:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788832344.609946:0:17247:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d2c3fc69800 from 9 10000000:01000000:2.0:1788832344.609953:0:17247:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788832344.610003:0:17247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538366 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832344.610015:0:17247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538366 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832344.610027:0:17247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538366 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832344.610056:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f37800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218481024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788832344.610126:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832344.610164:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06773480 going to sleep for 11 seconds 00000100:00100000:3.0:1788832344.610873:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218481024 00000100:00100000:3.0:1788832344.610882:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218481024 00000100:00100000:3.0:1788832344.610943:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788832344.610953:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+19:17247:x1875726218481024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832344.610966:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832344.610980:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c00030a00/0x998c12b28353836d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283538366 expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832344.611004:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c00030a00/0x998c12b28353836d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283538366 expref: 20 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832344.611015:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c00030a00/0x998c12b28353836d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283538366 expref: 20 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832344.611023:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00030a00, rc 0) 00000100:00100000:3.0:1788832344.611075:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+20:17247:x1875726218481024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832344.611082:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788832344.612431:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f37800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218481024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788832344.612455:0:17247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538366 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353836d expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832344.612465:0:17247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538366 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b28353836d expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832344.612533:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218481152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788832344.612585:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832344.612657:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c11fcaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788832344.612715:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218481152 00000100:00100000:2.0:1788832344.612722:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218481152 00000100:00100000:2.0:1788832344.612793:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788832344.612803:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+20:17247:x1875726218481152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788832344.612822:0:17245:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788832344.612838:0:17245:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788832344.612842:0:17245:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788832344.612935:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+20:17247:x1875726218481152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832344.612943:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788832344.613228:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218481152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788832344.613299:0:17247:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788832344.613308:0:17247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538366 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353836d expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832344.613318:0:17247:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353836d expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832344.613330:0:17247:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788832344.613332:0:17247:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d2b07d5b800 from 9 10000000:01000000:0.0:1788832344.613339:0:17247:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788832344.613364:0:17247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b283538374 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832344.613371:0:17247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b283538374 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832344.613391:0:17247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b283538374 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832344.613407:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218481280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788832344.613439:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832344.613464:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0322e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788832344.614486:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218481280 00000100:00100000:2.0:1788832344.614496:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218481280 00000100:00100000:2.0:1788832344.614550:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788832344.614559:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+20:17247:x1875726218481280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832344.614572:0:17244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832344.614587:0:17244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c01228c00/0x998c12b28353837b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283538374 expref: -99 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832344.614611:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c01228c00/0x998c12b28353837b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283538374 expref: 21 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832344.614637:0:17244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c01228c00/0x998c12b28353837b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283538374 expref: 21 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832344.614646:0:17244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c01228c00, rc 0) 00000100:00100000:2.0:1788832344.614705:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:17247:x1875726218481280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832344.614711:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788832344.614755:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218481280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832344.614771:0:17247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b283538374 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353837b expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832344.614794:0:17247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b283538374 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b28353837b expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832344.614860:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218481408:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788832344.614907:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832344.614935:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0322e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788832344.615468:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218481408 00000100:00100000:2.0:1788832344.615474:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218481408 00000100:00100000:2.0:1788832344.615519:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788832344.615526:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:17247:x1875726218481408:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788832344.615540:0:17245:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788832344.615556:0:17245:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788832344.615559:0:17245:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788832344.615974:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:17247:x1875726218481408:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 447us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832344.615982:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788832344.616018:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218481408:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788832344.616091:0:17247:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788832344.616100:0:17247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b283538374 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353837b expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832344.616110:0:17247:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b283538374 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353837b expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832344.794704:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832344.794728:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218481536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832344.794807:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832344.795392:0:17257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218481536 00000100:00100000:3.0:1788832344.795403:0:17257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218481536 00000100:00100000:3.0:1788832344.795457:0:17257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788832344.795467:0:17257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218481536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788832344.795502:0:17257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788832344.795558:0:17257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218481536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832344.795566:0:17257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788832344.795609:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218481536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832344.800162:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218481664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788832344.800237:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832344.800378:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218481664 00000100:00100000:3.0:1788832344.800386:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218481664 00000100:00100000:3.0:1788832344.800443:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788832344.800452:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218481664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788832344.800486:0:17256:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788832344.807503:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218481664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7039us (7252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832344.807518:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788832344.808720:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218481664:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788832344.985502:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832346.007690:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832347.030819:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788832347.543546:0:17287:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788832348.056344:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832348.376592:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e119a26-e2c8-49b5-8e81-f568246f48a1:3654:1875726218481792:0@lo:400:kworker.0 00000100:00100000:1.0:1788832348.376828:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788832348.376918:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788832348.376923:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788832348.376926:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788832348.376929:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788832348.376945:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788832348.376947:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788832348.376950:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788832348.376964:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788832348.377004:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218482176:0@lo:400:kworker.0 00000100:00100000:3.0:1788832348.377036:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832348.377075:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788832348.377081:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218482304:0@lo:400:kworker.0 00000100:00100000:3.0:1788832348.377106:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832348.377133:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218481920:0@lo:400:kworker.0 00000100:00100000:3.0:1788832348.377156:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832348.377182:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218482432:0@lo:400:kworker.0 00000100:00100000:3.0:1788832348.377207:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832348.377224:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788832348.377230:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218482048:0@lo:400:kworker.0 00000100:00100000:3.0:1788832348.377251:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832348.377269:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218482560:0@lo:400:kworker.0 00000100:00100000:3.0:1788832348.377289:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832348.377318:0:18308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218482176 00000100:00100000:3.0:1788832348.377325:0:18308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218482176 00000100:00100000:1.0:1788832348.377808:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218482304 00000100:00100000:1.0:1788832348.377814:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218482304 00000100:00100000:1.0:1788832348.377838:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218482432 00000100:00100000:1.0:1788832348.377841:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218482432 00000100:00100000:1.0:1788832348.377864:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218482048 00000100:00100000:1.0:1788832348.377867:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218482048 00000100:00100000:1.0:1788832348.377877:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218482560 00000100:00100000:1.0:1788832348.377880:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218482560 00000100:00100000:1.0:1788832348.377896:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788832348.377905:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218482304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832348.377961:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218482304:12345-0@lo:400:kworker.0 Request processed in 57us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832348.377969:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788832348.377997:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788832348.378004:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218482432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832348.378039:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218482432:12345-0@lo:400:kworker.0 Request processed in 35us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832348.378045:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788832348.378055:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788832348.378061:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218482048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832348.378087:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218482048:12345-0@lo:400:kworker.0 Request processed in 26us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832348.378093:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788832348.378103:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788832348.378109:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218482560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832348.378134:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218482560:12345-0@lo:400:kworker.0 Request processed in 25us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832348.378140:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788832348.378157:0:17257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218481920 00000100:00100000:1.0:1788832348.378161:0:17257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218481920 00000100:00100000:1.0:1788832348.378184:0:17257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788832348.378190:0:17257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218481920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832348.378220:0:17257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218481920:12345-0@lo:400:kworker.0 Request processed in 30us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832348.378225:0:17257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788832348.378246:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788832348.378250:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832348.378590:0:18308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788832348.378599:0:18308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218482176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832348.378665:0:18308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218482176:12345-0@lo:400:kworker.0 Request processed in 68us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832348.378672:0:18308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788832348.378726:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b084f7480 x1875726218482304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832348.378743:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218482304:0@lo:400:kworker.0 00000100:00100000:3.0:1788832348.378779:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218482176:0@lo:400:kworker.0 00010000:00080000:3.0:1788832348.378816:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b084f5880 x1875726218482048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832348.378825:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218482048:0@lo:400:kworker.0 00010000:00080000:3.0:1788832348.378835:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b084f7b80 x1875726218482560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832348.378842:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218482560:0@lo:400:kworker.0 00000100:00100000:3.0:1788832348.378852:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218481920:0@lo:400:kworker.0 00010000:00080000:3.0:1788832348.378861:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b084f5500 x1875726218482432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832348.378868:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218482432:0@lo:400:kworker.0 00000100:00100000:0.0:1788832348.379305:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218481792 00000100:00100000:0.0:1788832348.379313:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218481792 00000100:00100000:0.0:1788832348.379444:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788832348.379454:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:3654:x1875726218481792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832348.379523:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:3654:x1875726218481792:12345-0@lo:400:kworker.0 Request processed in 71us (2695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832348.379536:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788832348.379818:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e119a26-e2c8-49b5-8e81-f568246f48a1:3654:1875726218481792:0@lo:400:kworker.0 00010000:00010000:2.0:1788832349.086848:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788832349.244190:0:19123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788832349.910759:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788832349.910782:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218482688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788832349.910852:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832349.910899:0:18308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218482688 00000100:00100000:3.0:1788832349.910907:0:18308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218482688 00000100:00100000:3.0:1788832349.910949:0:18308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788832349.910957:0:18308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218482688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788832349.910991:0:18308:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788832349.911034:0:18308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218482688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832349.911051:0:18308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788832349.911098:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218482688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788832349.920044:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218482816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788832349.920119:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832349.920231:0:17257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218482816 00000100:00100000:1.0:1788832349.920239:0:17257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218482816 00000100:00100000:1.0:1788832349.920293:0:17257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788832349.920314:0:17257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218482816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788832349.920347:0:17257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788832349.920963:0:17257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218482816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 648us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832349.920972:0:17257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788832349.928840:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218482816:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788832350.102937:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788832350.305405:0:19175:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788832350.305618:0:19175:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1788832351.080096:0:19225:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788832351.080521:0:19225:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788832351.128592:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788832351.961558:0:18007:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788832352.151301:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832353.175020:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788832353.496700:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788832353.496706:0:14992:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788832353.496709:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788832353.496712:0:14992:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788832353.496749:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788832353.496752:0:14992:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788832353.496755:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788832353.496758:0:14992:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788832353.496797:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218483200:0@lo:400:kworker.0 00000100:00100000:3.0:1788832353.496859:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832353.496906:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218483712:0@lo:400:kworker.0 00000100:00100000:3.0:1788832353.496929:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832353.496951:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788832353.496968:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218483328:0@lo:400:kworker.0 00000100:00100000:3.0:1788832353.496994:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832353.497033:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218483328 00000100:00100000:3.0:1788832353.497041:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218483328 00000100:00100000:3.0:1788832353.497085:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788832353.497095:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218483328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832353.497150:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218483328:12345-0@lo:400:kworker.0 Request processed in 56us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832353.497157:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788832353.497197:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218483328:0@lo:400:kworker.0 00000100:00100000:2.0:1788832353.497283:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218483072:0@lo:400:kworker.0 00000100:00100000:2.0:1788832353.497312:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832353.497343:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1875726218483584:0@lo:400:kworker.0 00000100:00100000:2.0:1788832353.497370:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832353.497390:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788832353.497396:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e119a26-e2c8-49b5-8e81-f568246f48a1:3652:1875726218482944:0@lo:400:kworker.0 00000100:00100000:2.0:1788832353.497429:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832353.497451:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218483456:0@lo:400:kworker.0 00000100:00100000:2.0:1788832353.497472:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832353.497497:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218483200 00000100:00100000:2.0:1788832353.497501:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218483200 00000100:00100000:2.0:1788832353.497523:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218483712 00000100:00100000:2.0:1788832353.497526:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218483712 00000100:00100000:2.0:1788832353.497549:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218483584 00000100:00100000:2.0:1788832353.497552:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218483584 00000100:00100000:2.0:1788832353.497564:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218483456 00000100:00100000:2.0:1788832353.497567:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218483456 00000100:00100000:2.0:1788832353.497580:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788832353.497587:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218483200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832353.497647:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218483200:12345-0@lo:400:kworker.0 Request processed in 59us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832353.497653:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788832353.497667:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788832353.497674:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218483712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832353.497701:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218483712:12345-0@lo:400:kworker.0 Request processed in 28us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832353.497707:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788832353.497727:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788832353.497734:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875726218483584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832353.497764:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875726218483584:12345-0@lo:400:kworker.0 Request processed in 31us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832353.497770:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788832353.497780:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788832353.497793:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218483456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832353.497819:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218483456:12345-0@lo:400:kworker.0 Request processed in 27us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832353.497825:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788832353.497842:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218482944 00000100:00100000:2.0:1788832353.497845:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218482944 00000100:00100000:2.0:1788832353.497871:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788832353.497877:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18d07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:3652:x1875726218482944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832353.497904:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18d07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:3652:x1875726218482944:12345-0@lo:400:kworker.0 Request processed in 28us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832353.497910:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1788832353.497939:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788832353.497944:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788832353.497960:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e119a26-e2c8-49b5-8e81-f568246f48a1:3652:1875726218482944:0@lo:400:kworker.0 00010000:00080000:2.0:1788832353.497974:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b084f7480 x1875726218483456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832353.497986:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218483456:0@lo:400:kworker.0 00010000:00080000:2.0:1788832353.497997:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b084f5180 x1875726218483584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832353.498006:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1875726218483584:0@lo:400:kworker.0 00010000:00080000:2.0:1788832353.498038:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b084f5880 x1875726218483200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832353.498048:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218483200:0@lo:400:kworker.0 00010000:00080000:2.0:1788832353.498063:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b08552680 x1875726218483712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832353.498078:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218483712:0@lo:400:kworker.0 00000100:00100000:3.0:1788832353.498541:0:17257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218483072 00000100:00100000:3.0:1788832353.498547:0:17257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218483072 00000100:00100000:3.0:1788832353.498583:0:17257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788832353.498590:0:17257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218483072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832353.498786:0:17257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218483072:12345-0@lo:400:kworker.0 Request processed in 196us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832353.498793:0:17257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788832353.501798:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218483072:0@lo:400:kworker.0 00010000:00010000:2.0:1788832354.199894:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832354.205355:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788832339/real 1788832339] req@ffff9d2b07f34700 x1875726218475008/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788832354 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832354.205384:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d2b07f34700 x1875726218475008/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788832354 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832354.205394:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788832339/real 1788832339] req@ffff9d2b07f34a80 x1875726218475136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788832354 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832354.205404:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d2b07f34a80 x1875726218475136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788832354 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788832354.205423:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c054a5800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788832354.205511:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788832354.205515:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218475008:0@lo:8:kworker.0 00000100:00080000:0.0:1788832354.205521:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c39187000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788832354.205526:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788832354.205529:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218475136:0@lo:8:kworker.0 00000100:00080000:3.0:1788832354.207676:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788832354.207682:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788832354.207685:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788832354.207688:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788832354.207704:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788832354.207706:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788832354.207710:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d2c054a5800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788832354.207728:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 479 00000100:00080000:3.0:1788832354.207747:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788832354.207754:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9d2c054a5800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788832354.207777:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b08550380 x1875726218484352/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788832354.207791:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788832354.207794:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788832354.207795:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d2c39187000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788832354.207798:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 479 00000100:00080000:3.0:1788832354.207800:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788832354.207804:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d2c39187000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788832354.207813:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b08553b80 x1875726218484480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788832354.207861:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e119a26-e2c8-49b5-8e81-f568246f48a1:3654:1875726218483840:0@lo:400:kworker.0 00000100:00100000:3.0:1788832354.207929:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832354.207978:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875726218484608:0@lo:400:kworker.0 00000100:00100000:3.0:1788832354.208004:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832354.208032:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788832354.208037:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218484224:0@lo:400:kworker.0 00000100:00100000:3.0:1788832354.208059:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832354.208086:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218483968:0@lo:400:kworker.0 00000100:00100000:3.0:1788832354.208113:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832354.208130:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218484736:0@lo:400:kworker.0 00000100:00100000:3.0:1788832354.208152:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832354.208182:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788832354.208188:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218484096:0@lo:400:kworker.0 00000100:00100000:3.0:1788832354.208219:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832354.208236:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b084f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218484864:0@lo:400:kworker.0 00000100:00100000:3.0:1788832354.208254:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832354.208291:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218483840 00000100:00100000:3.0:1788832354.208297:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218483840 00000100:00100000:3.0:1788832354.208352:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788832354.208361:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18d07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:3654:x1875726218483840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832354.208407:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18d07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:3654:x1875726218483840:12345-0@lo:400:kworker.0 Request processed in 48us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832354.208414:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788832354.208571:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218484608 00000100:00100000:3.0:1788832354.208576:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218484608 00000100:00100000:3.0:1788832354.208598:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218484736 00000100:00100000:3.0:1788832354.208601:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218484736 00000100:00100000:3.0:1788832354.208612:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218484096 00000100:00100000:3.0:1788832354.208614:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218484096 00000100:00100000:3.0:1788832354.208646:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218484864 00000100:00100000:3.0:1788832354.208649:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218484864 00000100:00100000:3.0:1788832354.208662:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788832354.208668:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875726218484608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832354.208702:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1875726218484608:12345-0@lo:400:kworker.0 Request processed in 35us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832354.208708:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788832354.208732:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788832354.208738:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218484736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832354.208766:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218484736:12345-0@lo:400:kworker.0 Request processed in 29us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832354.208780:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788832354.208791:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788832354.208796:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218484096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832354.208821:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218484096:12345-0@lo:400:kworker.0 Request processed in 25us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832354.208826:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788832354.208836:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788832354.208840:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218484864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832354.208859:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218484864:12345-0@lo:400:kworker.0 Request processed in 19us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832354.208864:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788832354.208878:0:18308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218484224 00000100:00100000:3.0:1788832354.208881:0:18308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218484224 00000100:00100000:3.0:1788832354.208898:0:18308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218483968 00000100:00100000:3.0:1788832354.208900:0:18308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218483968 00000100:00100000:3.0:1788832354.208910:0:18308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788832354.208914:0:18308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218484224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832354.208945:0:18308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218484224:12345-0@lo:400:kworker.0 Request processed in 30us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832354.208950:0:18308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788832354.208961:0:18308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788832354.208965:0:18308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218483968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788832354.208989:0:18308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218483968:12345-0@lo:400:kworker.0 Request processed in 23us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832354.208995:0:18308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788832354.209055:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218484224:0@lo:400:kworker.0 00000100:00100000:3.0:1788832354.209065:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e119a26-e2c8-49b5-8e81-f568246f48a1:3654:1875726218483840:0@lo:400:kworker.0 00010000:00080000:3.0:1788832354.209077:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b08552300 x1875726218484608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832354.209086:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1875726218484608:0@lo:400:kworker.0 00010000:00080000:3.0:1788832354.209121:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b08553480 x1875726218484096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832354.209131:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218484096:0@lo:400:kworker.0 00010000:00080000:3.0:1788832354.209140:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b084f7b80 x1875726218484864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832354.209148:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b084f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218484864:0@lo:400:kworker.0 00000100:00100000:3.0:1788832354.209157:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218483968:0@lo:400:kworker.0 00010000:00080000:3.0:1788832354.209165:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b08552680 x1875726218484736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832354.209173:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218484736:0@lo:400:kworker.0 00000100:00100000:0.0:1788832354.211307:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218484352:0@lo:8:kworker.0 00000100:00100000:0.0:1788832354.211390:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832354.211448:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218484480:0@lo:8:kworker.0 00000100:00100000:0.0:1788832354.211474:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832354.211516:0:18758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218484352 00000100:00100000:0.0:1788832354.211520:0:18759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218484480 00000100:00100000:2.0:1788832354.211524:0:18758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218484352 00000100:00100000:0.0:1788832354.211526:0:18759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218484480 00000100:00100000:0.0:1788832354.211686:0:18759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788832354.211693:0:18759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1875726218484480:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788832354.211737:0:18759:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788832354.228280:0:18759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1875726218484480:12345-0@lo:8:kworker.0 Request processed in 16577us (16796us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788832354.228295:0:18759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788832354.228585:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c39187000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788832354.228591:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788832354.228595:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218484480:0@lo:8:kworker.0 00000100:00100000:0.0:1788832354.230117:0:18759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788832354.230128:0:18759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1875726218484352:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788832354.230175:0:18759:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:0.0:1788832354.230209:0:18759:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x998c12b283538382 00002000:00100000:0.0:1788832354.230226:0:18759:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9d2b08519800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788832354.230230:0:18759:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788832354.230232:0:18759:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788832354.230411:0:18759:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788832354.230448:0:18759:0:(import.c:65:import_set_state_nolock()) ffff9d2b0851b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788832354.230536:0:18759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1875726218484352:12345-0@lo:8:kworker.0 Request processed in 408us (19145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832354.230543:0:18759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788832354.231934:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b08550380 x1875726218484352/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788832374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832354.231947:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788832354.231957:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788832354.231966:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788832354.231973:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788832354.231977:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c054a5800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788832354.231990:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788832354.231995:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218484352:0@lo:8:kworker.0 00000004:00080000:1.0:1788832354.232026:0:17993:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788832354.232111:0:17993:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 494272489781ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788832354.232118:0:17993:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1788832354.234813:0:17994:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788832354.234843:0:17994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17994:1875726218485120:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788832354.234907:0:17994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832354.234936:0:17994:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0927f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832354.234959:0:18758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218485120 00000100:00100000:0.0:1788832354.234966:0:18758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218485120 00000100:00100000:0.0:1788832354.235028:0:18758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788832354.235037:0:18758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17994:x1875726218485120:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:0.0:1788832354.235214:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832354.235262:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832354.235275:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218484992:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788832354.235305:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788832354.238800:0:17985:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788832354.240148:0:18761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218484992 00000100:00100000:0.0:1788832354.240163:0:18761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218484992 00000100:00100000:0.0:1788832354.240220:0:18761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788832354.240230:0:18761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3654:x1875726218484992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788832354.240262:0:18761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788832354.240342:0:18761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3654:x1875726218484992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (5035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832354.240350:0:18761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788832354.240409:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b0756f800 x1875726218484992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832354.240430:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218484992:0@lo:13:osp-pre-0-1.0 00002000:00080000:1.0:1788832354.243370:0:18758:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788832354.243379:0:18758:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788832354.243472:0:18758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17994:x1875726218485120:12345-0@lo:7:osp-pre-0-1.0 Request processed in 8433us (8562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832354.243486:0:18758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788832354.243602:0:17994:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b0756ce00 x1875726218485120/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788832370 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832354.243618:0:17994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17994:1875726218485120:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788832354.243653:0:17994:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788832354.243692:0:17994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17994:1875726218485248:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788832354.243734:0:17994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832354.243770:0:17994:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c358c2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788832354.243838:0:18758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218485248 00000100:00100000:1.0:1788832354.243844:0:18758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218485248 00000100:00100000:1.0:1788832354.243877:0:18758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788832354.243885:0:18758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17994:x1875726218485248:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788832354.243906:0:18758:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788832354.243931:0:18758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17994:x1875726218485248:12345-0@lo:5:osp-pre-0-1.0 Request processed in 47us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832354.243937:0:18758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788832354.244006:0:17994:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fd0ed80 x1875726218485248/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788832370 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832354.244016:0:17994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17994:1875726218485248:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788832354.244023:0:17994:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788832354.244044:0:17994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17994:1875726218485376:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788832354.244063:0:17994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832354.244083:0:17994:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c358c2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788832354.244115:0:18758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218485376 00000100:00100000:1.0:1788832354.244119:0:18758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218485376 00000100:00100000:1.0:1788832354.244144:0:18758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788832354.244149:0:18758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17994:x1875726218485376:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788832354.244170:0:18758:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:3.0:1788832354.280347:0:18754:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788832354.280364:0:18754:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788832354.280810:0:18758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17994:x1875726218485376:12345-0@lo:5:osp-pre-0-1.0 Request processed in 36656us (36741us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788832354.280821:0:18758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788832354.282959:0:17994:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fd0ed80 x1875726218485376/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788832370 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832354.282976:0:17994:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788832354.282983:0:17994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17994:1875726218485376:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788832354.282999:0:17994:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1788832354.283050:0:17994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17994:1875726218485504:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788832354.283104:0:17994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832354.283174:0:17994:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c358c2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832354.284914:0:17263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218485504 00000100:00100000:2.0:1788832354.284927:0:17263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218485504 00000100:00100000:2.0:1788832354.284976:0:17263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788832354.284986:0:17263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17994:x1875726218485504:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788832354.285083:0:17263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17994:x1875726218485504:12345-0@lo:900:osp-pre-0-1.0 Request processed in 98us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832354.285091:0:17263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788832354.285216:0:17994:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fd0ed80 x1875726218485504/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788832370 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832354.285231:0:17994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17994:1875726218485504:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788832355.035990:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218485632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788832355.036089:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832355.036161:0:18308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218485632 00000100:00100000:3.0:1788832355.036171:0:18308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218485632 00000100:00100000:3.0:1788832355.036232:0:18308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788832355.036242:0:18308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b084f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218485632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788832355.036297:0:18308:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788832355.036346:0:18308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b084f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218485632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832355.036354:0:18308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788832355.036408:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218485632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788832355.037579:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788832355.037601:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218485760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788832355.037695:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832355.037761:0:17257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218485760 00000100:00100000:1.0:1788832355.037769:0:17257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218485760 00000100:00100000:1.0:1788832355.037820:0:17257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788832355.037831:0:17257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218485760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788832355.037884:0:17257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788832355.037939:0:17257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218485760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832355.037958:0:17257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788832355.038010:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218485760:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788832355.222777:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832356.250394:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832357.272542:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788832357.783469:0:17287:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1788832357.962428:0:19570:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788832357.962432:0:19570:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788832357.962433:0:19570:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788832357.962561:0:19570:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9d2b0646a000 00000020:01000004:3.0:1788832357.962575:0:19570:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788832357.962588:0:19570:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788832357.962601:0:19570:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9d2c18eccd28) 00000020:00000080:3.0:1788832357.962616:0:19570:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788832358.028854:0:19570:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788832358.030110:0:19570:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788832358.030583:0:19570:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788832358.030955:0:19570:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788832358.031231:0:19570:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788832358.031473:0:19570:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788832358.031728:0:19570:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:1.0:1788832358.034888:0:19570:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788832358.035300:0:19570:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788832358.035315:0:19570:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788832358.035326:0:19570:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x998c12b283538390 00000020:01000004:1.0:1788832358.035334:0:19570:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788832358.035356:0:19570:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.126@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788832358.035360:0:19570:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788832358.035365:0:19570:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788832358.035395:0:19570:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788832358.035399:0:19570:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.126@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788832358.044983:0:19570:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.126@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788832358.045022:0:19570:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.126@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788832358.045093:0:19570:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788832358.045096:0:19570:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788832358.045097:0:19570:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788832358.045099:0:19570:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788832358.045100:0:19570:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788832358.045101:0:19570:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788832358.045103:0:19570:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788832358.045105:0:19570:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788832358.045107:0:19570:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788832358.045111:0:19570:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788832358.045113:0:19570:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788832358.045115:0:19570:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788832358.045116:0:19570:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788832358.045117:0:19570:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788832358.045118:0:19570:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788832358.045120:0:19570:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788832358.045121:0:19570:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788832358.045122:0:19570:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788832358.045123:0:19570:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788832358.045153:0:19570:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788832358.045172:0:19570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218485888:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788832358.045242:0:19570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832358.045346:0:19570:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0927f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788832358.045423:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218485888 00000100:00100000:2.0:1788832358.045430:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218485888 00000100:00100000:2.0:1788832358.045510:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788832358.045519:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18d05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:19570:x1875726218485888:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788832358.045547:0:17244:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788832358.045551:0:17244:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788832358.045555:0:17244:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788832358.045885:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18d05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:19570:x1875726218485888:12345-0@lo:253:mount.lustre.0 Request processed in 365us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832358.045893:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788832358.045989:0:19570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218485888:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788832358.045999:0:19570:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788832358.046002:0:19570:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788832358.046003:0:19570:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788832358.046004:0:19570:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832358.046006:0:19570:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832358.046007:0:19570:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832358.046008:0:19570:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832358.046009:0:19570:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788832358.046011:0:19570:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832358.046012:0:19570:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788832358.046042:0:19570:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d2b0646a000 from lustre-OST0001 10000000:01000000:0.0:1788832358.046070:0:19570:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788832358.046078:0:19570:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788832358.046087:0:19570:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d2b06008000 local copy 00010000:00010000:0.0:1788832358.046097:0:19570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2e00/0x998c12b2835380aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835380b1 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832358.046184:0:19570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218486016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788832358.046214:0:19570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832358.046789:0:19570:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c083f5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788832358.046865:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218486016 00000100:00100000:3.0:1788832358.046872:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218486016 00000100:00100000:3.0:1788832358.046906:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788832358.046913:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18d04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:19570:x1875726218486016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788832358.046996:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18d04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:19570:x1875726218486016:12345-0@lo:501:mount.lustre.0 Request processed in 83us (781us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788832358.047002:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788832358.047194:0:19570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218486016:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788832358.047211:0:19570:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788832358.047232:0:19570:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788832358.047240:0:19570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2e00/0x998c12b2835380aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835380b1 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832358.047251:0:19570:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c421d2e00/0x998c12b2835380aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835380b1 expref: -99 pid: 17230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832358.047279:0:19570:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d2b0646a000 10000000:01000000:0.0:1788832358.047283:0:19570:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788832358.047299:0:19570:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788832358.047302:0:19570:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788832358.047306:0:19570:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788832358.047309:0:19570:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788832358.047333:0:19570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d800/0x998c12b283538397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832358.047341:0:19570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d800/0x998c12b283538397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832358.047366:0:19570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d800/0x998c12b283538397 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832358.047382:0:19570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218486144:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788832358.047410:0:19570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832358.047432:0:19570:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c083f5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788832358.047538:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218486144 00000100:00100000:3.0:1788832358.047544:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218486144 00000100:00100000:3.0:1788832358.047566:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788832358.047572:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:19570:x1875726218486144:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788832358.047580:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832358.047591:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c00031800/0x998c12b28353839e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283538397 expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832358.047614:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c00031800/0x998c12b28353839e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283538397 expref: 22 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832358.047659:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c00031800/0x998c12b28353839e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283538397 expref: 22 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832358.047667:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031800, rc 0) 00000100:00100000:3.0:1788832358.047705:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+22:19570:x1875726218486144:12345-0@lo:101:mount.lustre.0 Request processed in 133us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832358.047712:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788832358.047877:0:19570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218486144:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788832358.047890:0:19570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d800/0x998c12b283538397 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353839e expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832358.047899:0:19570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d800/0x998c12b283538397 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b28353839e expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788832358.049120:0:19570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788832358.049713:0:19570:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788832358.052894:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788832358.052949:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788832358.052966:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788832358.052980:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788832358.052993:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788832358.053006:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788832358.053105:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788832358.053113:0:19570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788832358.053221:0:19570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218486272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788832358.053349:0:19570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832358.053437:0:19570:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b077fb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788832358.053483:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218486272 00000100:00100000:3.0:1788832358.053490:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218486272 00000100:00100000:3.0:1788832358.053568:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788832358.053579:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18d05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+22:19570:x1875726218486272:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788832358.053899:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18d05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+22:19570:x1875726218486272:12345-0@lo:501:mount.lustre.0 Request processed in 321us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832358.053908:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788832358.053976:0:19570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218486272:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788832358.054012:0:19570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218486400:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788832358.054069:0:19570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832358.054391:0:19570:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36d19840 going to sleep for 11 seconds 00000100:00100000:2.0:1788832358.054455:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218486400 00000100:00100000:2.0:1788832358.054460:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218486400 00000100:00100000:2.0:1788832358.054485:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788832358.054492:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+22:19570:x1875726218486400:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788832358.055365:0:19570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218486400:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788832358.055832:0:19570:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788832358.055926:0:19570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218486528:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788832358.055972:0:19570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832358.055996:0:19570:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36d19840 going to sleep for 11 seconds 00000100:00100000:2.0:1788832358.056593:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+22:19570:x1875726218486400:12345-0@lo:503:mount.lustre.0 Request processed in 787us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832358.056607:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788832358.056678:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218486528 00000100:00100000:2.0:1788832358.056685:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218486528 00000100:00100000:2.0:1788832358.056728:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788832358.056736:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+22:19570:x1875726218486528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788832358.057243:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+22:19570:x1875726218486528:12345-0@lo:502:mount.lustre.0 Request processed in 507us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832358.057250:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788832358.057480:0:19570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218486528:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788832358.057731:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788832358.057772:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788832358.057789:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788832358.057803:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788832358.057815:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788832358.057829:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788832358.057843:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788832358.057856:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788832358.057869:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788832358.057901:0:19570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218486656:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788832358.057945:0:19570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832358.057974:0:19570:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36d19840 going to sleep for 11 seconds 00000100:00100000:2.0:1788832358.058295:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218486656 00000100:00100000:2.0:1788832358.058301:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218486656 00000100:00100000:2.0:1788832358.058331:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788832358.058338:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+22:19570:x1875726218486656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788832358.058433:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+22:19570:x1875726218486656:12345-0@lo:502:mount.lustre.0 Request processed in 94us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832358.058441:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788832358.058575:0:19570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218486656:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788832358.058652:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788832358.058662:0:19570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788832358.059514:0:19574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788832358.059522:0:19574:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788832358.059529:0:19574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832358.059531:0:19574:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788832358.059538:0:19574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788832358.059552:0:19574:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9d2c18ecb370) 00000020:00000080:3.0:1788832358.059575:0:19574:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788832358.059582:0:19574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788832358.059706:0:19574:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d2b0646a000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788832358.059716:0:19574:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788832358.059723:0:19574:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x998c12b2835383ac 00010000:00010000:3.0:1788832358.064488:0:19574:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788832358.065126:0:19574:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1788832358.067149:0:19574:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788832358.068970:0:19574:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788832358.068983:0:19574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832358.068990:0:19574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832358.068992:0:19574:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788832358.068996:0:19574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832358.069000:0:19574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832358.069002:0:19574:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788832358.069005:0:19574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788832358.069007:0:19574:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788832358.069009:0:19574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832358.069020:0:19574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832358.069021:0:19574:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788832358.069024:0:19574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788832358.069099:0:19574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832358.069101:0:19574:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788832358.069105:0:19574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788832358.069131:0:19574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788832358.069133:0:19574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788832358.069135:0:19574:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788832358.069138:0:19574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788832358.069277:0:19570:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788832358.069317:0:19570:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788832358.069339:0:19570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d800/0x998c12b283538397 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353839e expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832358.069352:0:19570:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0d800/0x998c12b283538397 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353839e expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832358.069361:0:19570:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2b0646a000 from 1 10000000:01000000:0.0:1788832358.069363:0:19570:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788832358.069395:0:19570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b2835383b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832358.069404:0:19570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b2835383b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832358.069421:0:19570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b2835383b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832358.069446:0:19570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218486784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788832358.069507:0:19570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832358.069548:0:19570:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36d19f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788832358.069603:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218486784 00000100:00100000:1.0:1788832358.069611:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218486784 00000100:00100000:1.0:1788832358.069682:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788832358.069700:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+22:19570:x1875726218486784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788832358.069713:0:17244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832358.069726:0:17244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2b07cffa00/0x998c12b2835383ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b2835383b3 expref: -99 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832358.069771:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2b07cffa00/0x998c12b2835383ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b2835383b3 expref: 23 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832358.069782:0:17244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2b07cffa00/0x998c12b2835383ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835383b3 expref: 23 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832358.069791:0:17244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cffa00, rc 0) 00000100:00100000:1.0:1788832358.069826:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+23:19570:x1875726218486784:12345-0@lo:101:mount.lustre.0 Request processed in 127us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832358.069832:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788832358.070109:0:19570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218486784:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788832358.070122:0:19570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b2835383b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835383ba expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832358.070132:0:19570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b2835383b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b2835383ba expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788832358.071400:0:19570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788832358.071681:0:19570:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788832358.071861:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788832358.071887:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788832358.071923:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788832358.071930:0:19570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788832358.071991:0:19570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218486912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788832358.072175:0:19570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832358.072214:0:19570:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36d19480 going to sleep for 11 seconds 00000100:00100000:3.0:1788832358.072401:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218486912 00000100:00100000:3.0:1788832358.072408:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218486912 00000100:00100000:3.0:1788832358.072457:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788832358.072466:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+23:19570:x1875726218486912:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788832358.072585:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+23:19570:x1875726218486912:12345-0@lo:501:mount.lustre.0 Request processed in 120us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832358.072593:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788832358.072763:0:19570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218486912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788832358.072796:0:19570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218487040:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788832358.072840:0:19570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832358.072867:0:19570:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36d19480 going to sleep for 11 seconds 00000100:00100000:3.0:1788832358.072988:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218487040 00000100:00100000:3.0:1788832358.072992:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218487040 00000100:00100000:3.0:1788832358.073022:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788832358.073101:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+23:19570:x1875726218487040:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788832358.073227:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+23:19570:x1875726218487040:12345-0@lo:503:mount.lustre.0 Request processed in 196us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832358.073234:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788832358.076665:0:19570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218487040:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788832358.077273:0:19570:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788832358.077372:0:19570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218487168:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788832358.077446:0:19570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832358.077490:0:19570:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0304ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832358.077677:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218487168 00000100:00100000:2.0:1788832358.077684:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218487168 00000100:00100000:2.0:1788832358.077741:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788832358.077850:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+23:19570:x1875726218487168:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788832358.077970:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+23:19570:x1875726218487168:12345-0@lo:502:mount.lustre.0 Request processed in 123us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832358.077978:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788832358.078148:0:19570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218487168:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788832358.078422:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788832358.078451:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788832358.078466:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788832358.078479:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788832358.078492:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788832358.078504:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788832358.078517:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788832358.078528:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788832358.078541:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788832358.078553:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788832358.078565:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788832358.078598:0:19570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218487296:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788832358.078712:0:19570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832358.078772:0:19570:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0760f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832358.081829:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218487296 00000100:00100000:0.0:1788832358.081844:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218487296 00000100:00100000:0.0:1788832358.081913:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788832358.081923:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+23:19570:x1875726218487296:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788832358.084884:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+23:19570:x1875726218487296:12345-0@lo:502:mount.lustre.0 Request processed in 2952us (6162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832358.084901:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788832358.086508:0:19570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218487296:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788832358.086613:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788832358.087011:0:19570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788832358.088238:0:19578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832358.088248:0:19578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832358.088250:0:19578:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788832358.088259:0:19578:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d2b0646a000 00000020:00000080:1.0:1788832358.088262:0:19578:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788832358.088272:0:19578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832358.088274:0:19578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832358.088275:0:19578:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788832358.088278:0:19578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832358.088281:0:19578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832358.088282:0:19578:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788832358.088520:0:19578:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d2b0646a000 00000020:00000080:1.0:1788832358.088523:0:19578:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788832358.088664:0:19578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832358.088668:0:19578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832358.088669:0:19578:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788832358.088672:0:19578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832358.088675:0:19578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832358.088676:0:19578:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788832358.088680:0:19578:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d2b0646a000 00000020:00000080:1.0:1788832358.088682:0:19578:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788832358.092415:0:19578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832358.092426:0:19578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832358.092429:0:19578:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788832358.092433:0:19578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788832358.092437:0:19578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832358.092439:0:19578:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788832358.092451:0:19578:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d2b0646a000 00000020:00000080:1.0:1788832358.092454:0:19578:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788832358.092514:0:19578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788832358.092517:0:19578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788832358.092519:0:19578:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788832358.092522:0:19578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788832358.101767:0:19570:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788832358.101813:0:19570:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788832358.101836:0:19570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b2835383b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835383ba expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.101848:0:19570:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b2835383b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835383ba expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832358.101904:0:19570:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788832358.101907:0:19570:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d2b0646a000 10000000:01000000:2.0:1788832358.101911:0:19570:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d2b0646a000 10000000:01000000:2.0:1788832358.101914:0:19570:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788832358.101921:0:19570:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9d2b0646a000 from 1 10000000:01000000:2.0:1788832358.101924:0:19570:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788832358.101958:0:19570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c01229400/0x998c12b2835383c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.101966:0:19570:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c01229400/0x998c12b2835383c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.101985:0:19570:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c01229400/0x998c12b2835383c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832358.102009:0:19570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218487424:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788832358.103268:0:19570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832358.103455:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218487424 00000100:00100000:1.0:1788832358.103465:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218487424 00000100:00100000:1.0:1788832358.103509:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788832358.103519:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+23:19570:x1875726218487424:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788832358.103533:0:17244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832358.103547:0:17244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2b07cfee00/0x998c12b2835383c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b2835383c1 expref: -99 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832358.103572:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2b07cfee00/0x998c12b2835383c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b2835383c1 expref: 24 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832358.103583:0:17244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2b07cfee00/0x998c12b2835383c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835383c1 expref: 24 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832358.103592:0:17244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfee00, rc 0) 00000100:00100000:1.0:1788832358.110221:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:19570:x1875726218487424:12345-0@lo:101:mount.lustre.0 Request processed in 6691us (6943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832358.110234:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788832358.113796:0:19570:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b077fb000 going to sleep for 11 seconds 00000100:00100000:2.0:1788832358.113838:0:19570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218487424:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788832358.113864:0:19570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c01229400/0x998c12b2835383c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835383c8 expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.113877:0:19570:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c01229400/0x998c12b2835383c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b2835383c8 expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788832358.117738:0:19570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1788832358.118012:0:19570:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788832358.119313:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788832358.119343:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788832358.119356:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788832358.119369:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788832358.119381:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788832358.119393:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788832358.119405:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788832358.119417:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788832358.119429:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788832358.119440:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788832358.119452:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788832358.119464:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788832358.119476:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788832358.119489:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788832358.119512:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788832358.119527:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788832358.119539:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788832358.119551:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788832358.119564:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788832358.119576:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788832358.119589:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788832358.119600:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788832358.119611:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788832358.119641:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788832358.119655:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788832358.119667:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788832358.119679:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788832358.119705:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788832358.119718:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788832358.119729:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788832358.119741:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788832358.119752:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788832358.119765:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788832358.119777:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788832358.119791:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788832358.119817:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788832358.119832:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788832358.119845:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788832358.119859:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1788832358.119870:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1788832358.119882:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1788832358.119892:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1788832358.119904:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1788832358.119917:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1788832358.119929:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1788832358.119939:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1788832358.119957:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1788832358.119970:0:19570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1788832358.120069:0:19570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218487552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788832358.120130:0:19570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832358.120182:0:19570:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c21b37e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832358.120429:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218487552 00000100:00100000:0.0:1788832358.120436:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218487552 00000100:00100000:0.0:1788832358.120487:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788832358.120498:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:19570:x1875726218487552:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788832358.120640:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:19570:x1875726218487552:12345-0@lo:501:mount.lustre.0 Request processed in 144us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832358.120649:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788832358.124827:0:19570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218487552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788832358.124889:0:19570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218487680:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788832358.124961:0:19570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832358.124996:0:19570:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c21b37e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832358.128182:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218487680 00000100:00100000:0.0:1788832358.128195:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218487680 00000100:00100000:0.0:1788832358.128259:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788832358.128270:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:19570:x1875726218487680:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788832358.129878:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:19570:x1875726218487680:12345-0@lo:503:mount.lustre.0 Request processed in 1603us (4910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832358.129891:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788832358.133441:0:19570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218487680:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788832358.135853:0:19570:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788832358.135955:0:19570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218487808:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788832358.138737:0:19570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832358.138791:0:19570:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832358.138845:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218487808 00000100:00100000:2.0:1788832358.138854:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218487808 00000100:00100000:2.0:1788832358.138903:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788832358.138913:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:19570:x1875726218487808:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788832358.139059:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:19570:x1875726218487808:12345-0@lo:502:mount.lustre.0 Request processed in 147us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832358.139066:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788832358.140814:0:19570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218487808:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788832358.141116:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788832358.141145:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788832358.141159:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788832358.141171:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788832358.141182:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788832358.141193:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788832358.141205:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788832358.141231:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788832358.141244:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788832358.141255:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788832358.141266:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788832358.141278:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788832358.142152:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788832358.142174:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788832358.142187:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788832358.142199:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788832358.142210:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788832358.142220:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788832358.142231:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788832358.142243:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788832358.142254:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788832358.142266:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788832358.142278:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788832358.142382:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788832358.142398:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788832358.142412:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788832358.142423:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788832358.142434:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788832358.142446:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788832358.142458:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788832358.142470:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788832358.142483:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788832358.142508:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788832358.142522:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788832358.142533:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788832358.142544:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788832358.142555:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788832358.142566:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788832358.142577:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788832358.142601:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788832358.142634:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788832358.142652:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788832358.142664:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788832358.142677:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788832358.142703:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788832358.142718:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788832358.142732:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788832358.142745:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1788832358.142797:0:19570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218487936:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788832358.142873:0:19570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832358.142913:0:19570:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832358.143401:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218487936 00000100:00100000:0.0:1788832358.143410:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218487936 00000100:00100000:0.0:1788832358.143466:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788832358.143476:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:19570:x1875726218487936:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788832358.143597:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:19570:x1875726218487936:12345-0@lo:502:mount.lustre.0 Request processed in 122us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832358.143611:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788832358.144169:0:19570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218487936:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788832358.144921:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788832358.144951:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788832358.144986:0:19570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218488064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788832358.146404:0:19570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832358.146459:0:19570:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788832358.147143:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218488064 00000100:00100000:0.0:1788832358.147153:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218488064 00000100:00100000:0.0:1788832358.147207:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788832358.147217:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:19570:x1875726218488064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788832358.147434:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:19570:x1875726218488064:12345-0@lo:502:mount.lustre.0 Request processed in 218us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832358.147442:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788832358.147591:0:19570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218488064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788832358.147684:0:19570:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788832358.147705:0:19570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788832358.151526:0:19584:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788832358.151552:0:19584:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9d2c35990000) 00000020:00000080:3.0:1788832358.151577:0:19584:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788832358.151849:0:19584:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d2b0646a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788832358.151854:0:19584:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d2b0646a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788832358.151857:0:19584:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d2b0646a000 3 00010000:00080000:3.0:1788832358.151886:0:19584:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2b010ff800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.126@tcp at head 00010000:00010000:3.0:1788832358.154108:0:19584:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1788832358.154350:0:19584:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788832358.154388:0:19584:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788832358.154399:0:19584:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x998c12b2835383d6 00000100:00080000:3.0:1788832358.154408:0:19584:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788832358.154413:0:19584:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d2b010ff800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:3.0:1788832358.154442:0:19584:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c3fd0ed80 x1875726218488192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788832358.154470:0:19584:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788832358.154616:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788832358.154638:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788832358.154641:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788832358.154644:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788832358.154672:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788832358.154675:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788832358.154677:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d2c39187000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788832358.154681:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 494 00000100:00080000:0.0:1788832358.154695:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788832358.154700:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d2c39187000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788832358.154713:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b0756f480 x1875726218488832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788832358.154757:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218488704:0@lo:400:kworker.0 00000100:00100000:0.0:1788832358.154820:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832358.154854:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788832358.154868:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218488320:0@lo:400:kworker.0 00000100:00100000:0.0:1788832358.154894:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832358.154913:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218488960:0@lo:400:kworker.0 00000100:00100000:0.0:1788832358.154935:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832358.154963:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218488448:0@lo:400:kworker.0 00000100:00100000:0.0:1788832358.154985:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832358.155002:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218489088:0@lo:400:kworker.0 00000100:00100000:0.0:1788832358.155020:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832358.155052:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788832358.155059:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218488576:0@lo:400:kworker.0 00000100:00100000:0.0:1788832358.155078:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832358.155099:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218489216:0@lo:400:kworker.0 00000100:00100000:0.0:1788832358.155120:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832358.155153:0:18760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218488704 00000100:00100000:0.0:1788832358.155160:0:18760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218488704 00000100:00100000:0.0:1788832358.155205:0:18760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788832358.155213:0:18760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218488704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832358.155257:0:18760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218488704:12345-0@lo:400:kworker.0 Request processed in 45us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832358.155263:0:18760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788832358.155293:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218488320 00000100:00100000:0.0:1788832358.155297:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218488320 00000100:00100000:0.0:1788832358.155317:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218488576 00000100:00100000:0.0:1788832358.155320:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218488576 00000100:00100000:0.0:1788832358.155334:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788832358.155341:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218488320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832358.155391:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218488320:12345-0@lo:400:kworker.0 Request processed in 50us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832358.155398:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788832358.155410:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788832358.155416:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218488576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832358.155446:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218488576:12345-0@lo:400:kworker.0 Request processed in 31us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832358.155453:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788832358.155468:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218488960 00000100:00100000:0.0:1788832358.155472:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218488960 00000100:00100000:0.0:1788832358.155488:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218488448 00000100:00100000:0.0:1788832358.155490:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218488448 00000100:00100000:0.0:1788832358.155499:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218489088 00000100:00100000:0.0:1788832358.155501:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218489088 00000100:00100000:0.0:1788832358.155511:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218489216 00000100:00100000:0.0:1788832358.155514:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218489216 00000100:00100000:0.0:1788832358.155528:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788832358.155534:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218488960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832358.155564:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1875726218488960:12345-0@lo:400:kworker.0 Request processed in 29us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832358.155570:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788832358.155580:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788832358.155586:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218488448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832358.155608:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218488448:12345-0@lo:400:kworker.0 Request processed in 23us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832358.155614:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788832358.155646:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788832358.155659:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218489088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832358.155695:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1875726218489088:12345-0@lo:400:kworker.0 Request processed in 27us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832358.155702:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788832358.155714:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788832358.155720:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218489216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832358.155744:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218489216:12345-0@lo:400:kworker.0 Request processed in 25us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832358.155750:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788832358.155776:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788832358.155780:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788832358.155782:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788832358.155889:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218488576:0@lo:400:kworker.0 00010000:00080000:0.0:1788832358.155901:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fc07100 x1875726218489216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832358.155911:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218489216:0@lo:400:kworker.0 00010000:00080000:0.0:1788832358.155920:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b0756f800 x1875726218488448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832358.155928:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218488448:0@lo:400:kworker.0 00010000:00080000:0.0:1788832358.155936:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fc06a00 x1875726218489088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832358.155944:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1875726218489088:0@lo:400:kworker.0 00000100:00100000:0.0:1788832358.155977:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218488320:0@lo:400:kworker.0 00010000:00080000:0.0:1788832358.155999:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fc04380 x1875726218488960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832358.156006:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1875726218488960:0@lo:400:kworker.0 00010000:00080000:0.0:1788832358.156016:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b0756c700 x1875726218488704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832358.156023:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218488704:0@lo:400:kworker.0 00000100:00100000:2.0:1788832358.156238:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1875726218488192:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788832358.156275:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832358.156317:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0756f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218488832:0@lo:8:kworker.0 00000100:00100000:2.0:1788832358.156341:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1788832358.156462:0:19584:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788832358.156476:0:19584:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9d2b061719b8) 00000020:00000080:2.0:1788832358.156497:0:19584:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1788832358.156594:0:19584:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d2b0646a000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788832358.156598:0:19584:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d2b0646a000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788832358.156607:0:19584:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d2b0646a000 3 00010000:00080000:2.0:1788832358.156659:0:19584:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d2b06015800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.126@tcp at head 00010000:00010000:2.0:1788832358.158229:0:19584:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00100000:0.0:1788832358.158576:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218488192 00000100:00100000:0.0:1788832358.158586:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218488192 00000100:00100000:0.0:1788832358.158653:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788832358.158661:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1875726218488192:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788832358.158695:0:17253:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:0.0:1788832358.158731:0:17253:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x998c12b2835383e4 00000004:00100000:0.0:1788832358.158750:0:17253:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788832358.158786:0:17253:0:(import.c:65:import_set_state_nolock()) ffff9d2b0851a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788832358.158869:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875726218488192:12345-0@lo:38:llog_process_th.0 Request processed in 208us (2592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832358.158877:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788832358.158924:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2c3fd0ed80 x1875726218488192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788832368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832358.158935:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788832358.158942:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788832358.158951:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788832358.158955:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788832358.158957:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2b010ff800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788832358.158973:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1875726218488192:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788832358.159166:0:18758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218488832 00000100:00100000:1.0:1788832358.159171:0:18758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218488832 00000100:00100000:1.0:1788832358.159234:0:18758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788832358.159240:0:18758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1875726218488832:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788832358.159302:0:18758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1875726218488832:12345-0@lo:8:kworker.0 Request processed in 61us (2959us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788832358.159317:0:18758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788832358.159365:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788832358.159370:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c39187000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788832358.159374:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788832358.159377:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0756f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218488832:0@lo:8:kworker.0 00000020:00000080:2.0:1788832358.159857:0:19584:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788832358.159896:0:19584:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788832358.159905:0:19584:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x998c12b2835383eb 00000100:00080000:2.0:1788832358.159912:0:19584:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788832358.159917:0:19584:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9d2b06015800 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:2.0:1788832358.159943:0:19584:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2b07f34700 x1875726218489344/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788832358.159964:0:19584:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788832358.159989:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788832358.159993:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788832358.159996:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788832358.159999:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788832358.160298:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1875726218489344:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788832358.160345:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832358.160493:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218489344 00000100:00100000:2.0:1788832358.160498:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218489344 00000100:00100000:2.0:1788832358.160531:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788832358.160537:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fd0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1875726218489344:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788832358.160557:0:17251:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:2.0:1788832358.160599:0:17251:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x998c12b2835383f2 00000004:00100000:2.0:1788832358.160614:0:17251:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788832358.160659:0:17251:0:(import.c:65:import_set_state_nolock()) ffff9d2b0617a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832358.160716:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fd0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875726218489344:12345-0@lo:38:llog_process_th.0 Request processed in 177us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832358.160724:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788832358.160764:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d2b07f34700 x1875726218489344/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788832368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832358.160774:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788832358.160780:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788832358.160787:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788832358.160790:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788832358.160793:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2b06015800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788832358.160798:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1875726218489344:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788832358.160892:0:19584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1788832358.161185:0:19570:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788832358.161217:0:19570:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788832358.161274:0:19570:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c01229400/0x998c12b2835383c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835383c8 expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832358.161640:0:19570:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c01229400/0x998c12b2835383c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b2835383c8 expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788832358.161751:0:19570:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788832358.161754:0:19570:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788832358.161755:0:19570:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832358.161756:0:19570:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832358.161758:0:19570:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832358.161759:0:19570:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832358.161761:0:19570:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788832358.161763:0:19570:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832358.161764:0:19570:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788832358.161768:0:19570:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788832358.161771:0:19570:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788832358.161772:0:19570:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788832358.161773:0:19570:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832358.161775:0:19570:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832358.161776:0:19570:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832358.161777:0:19570:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832358.161778:0:19570:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788832358.161780:0:19570:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832358.161781:0:19570:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788832358.161800:0:19570:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788832358.161814:0:19570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218489472:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788832358.161861:0:19570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832358.161889:0:19570:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36d19f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788832358.161968:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218489472 00000100:00100000:2.0:1788832358.161974:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218489472 00000100:00100000:2.0:1788832358.162018:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788832358.162036:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:19570:x1875726218489472:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788832358.162060:0:17244:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788832358.162074:0:17244:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788832358.176480:0:17244:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788832358.176498:0:17244:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788832358.176832:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:19570:x1875726218489472:12345-0@lo:253:mount.lustre.0 Request processed in 14802us (14965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832358.176843:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 20000000:01000000:1.0:1788832358.177230:0:17267:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788832358.177235:0:17267:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788832358.177254:0:17267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d2b07cff200/0x998c12b2835383f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832358.177270:0:17267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c00030a00/0x998c12b28353836d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283538366 expref: 23 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832358.177278:0:17267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c01228c00/0x998c12b28353837b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283538374 expref: 23 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832358.177347:0:17267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d2b07cff200/0x998c12b2835383f9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832358.177381:0:17267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c01228c00/0x998c12b28353837b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283538374 expref: 23 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832358.177438:0:17267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2c01228c00/0x998c12b28353837b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283538374 expref: 23 pid: 17244 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832358.177452:0:17267:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17267:1875726218489600:0@lo:104: 00000100:00100000:1.0:1788832358.177488:0:17267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788832358.177569:0:17267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c00030a00/0x998c12b28353836d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283538366 expref: 23 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832358.177579:0:17267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2c00030a00/0x998c12b28353836d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283538366 expref: 23 pid: 17243 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832358.177588:0:17267:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17267:1875726218489728:0@lo:104: 00000100:00100000:1.0:1788832358.177644:0:17267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832358.179146:0:19570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e119a26-e2c8-49b5-8e81-f568246f48a1:19570:1875726218489472:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788832358.179169:0:19570:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788832358.179172:0:19570:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788832358.179174:0:19570:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788832358.179175:0:19570:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788832358.179177:0:19570:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788832358.179178:0:19570:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788832358.179179:0:19570:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788832358.179180:0:19570:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788832358.179182:0:19570:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788832358.179183:0:19570:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788832358.179196:0:19570:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788832358.184942:0:17267:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0760f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832358.189117:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218489600 00000100:00100000:2.0:1788832358.189130:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218489600 00000100:00100000:2.0:1788832358.189172:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218489728 00000100:00100000:2.0:1788832358.189174:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218489728 00000100:00100000:2.0:1788832358.189191:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788832358.189200:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e119a26-e2c8-49b5-8e81-f568246f48a1+4:17267:x1875726218489600:12345-0@lo:104: 00010000:00010000:2.0:1788832358.189217:0:17235:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b283538374 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b28353837b expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.189370:0:17235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788832358.189377:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e119a26-e2c8-49b5-8e81-f568246f48a1+4:17267:x1875726218489600:12345-0@lo:104: Request processed in 178us (11889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832358.189384:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788832358.189411:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788832358.189418:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e119a26-e2c8-49b5-8e81-f568246f48a1+3:17267:x1875726218489728:12345-0@lo:104: 00010000:00010000:2.0:1788832358.189426:0:17235:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b28353836d expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.189460:0:17235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788832358.189465:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e119a26-e2c8-49b5-8e81-f568246f48a1+3:17267:x1875726218489728:12345-0@lo:104: Request processed in 49us (11846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832358.189472:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788832358.189720:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788832358.189728:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b283538374 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b28353837b expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.189735:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0ce00 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832358.189740:0:17240:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b283538374 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b28353837b expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.189748:0:17240:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b283538374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b28353837b expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832358.189756:0:17240:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b283538374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b28353837b expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832358.189761:0:17240:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832358.189797:0:17240:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b283538374 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353837b expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.189804:0:17240:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832358.189824:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b283538374 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353837b expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.189843:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0ce00/0x998c12b283538374 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353837b expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.189855:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832358.189858:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b28353836d expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.189864:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01229000 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:2.0:1788832358.189867:0:17240:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b28353836d expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.189874:0:17240:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b28353836d expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832358.189880:0:17240:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b28353836d expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832358.189884:0:17240:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788832358.189899:0:17240:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538366 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353836d expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.189904:0:17240:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788832358.189911:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538366 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353836d expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.189918:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538366 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b28353836d expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.189932:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832358.189938:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832358.189940:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832358.189946:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832358.189966:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e119a26-e2c8-49b5-8e81-f568246f48a1:3651:1875726218489856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832358.190004:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832358.190046:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832358.190051:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e119a26-e2c8-49b5-8e81-f568246f48a1:3651:1875726218489984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832358.190070:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832358.190103:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218489856 00000100:00100000:2.0:1788832358.190107:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218489856 00010000:00010000:2.0:1788832358.190123:0:17238:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c01228c00/0x998c12b28353837b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283538374 expref: 24 pid: 17244 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832358.190141:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218489984 00000100:00100000:2.0:1788832358.190144:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218489984 00010000:00010000:2.0:1788832358.190154:0:17238:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c00030a00/0x998c12b28353836d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283538366 expref: 25 pid: 17243 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832358.190166:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788832358.190172:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e119a26-e2c8-49b5-8e81-f568246f48a1+25:3651:x1875726218489856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788832358.190182:0:17238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832358.190187:0:17238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c01228c00/0x998c12b28353837b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283538374 expref: 25 pid: 17244 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.190197:0:17238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c01228c00/0x998c12b28353837b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283538374 expref: 25 pid: 17244 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.190212:0:17238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832358.190238:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e119a26-e2c8-49b5-8e81-f568246f48a1+25:3651:x1875726218489856:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832358.190253:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788832358.190266:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788832358.190272:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:3651:x1875726218489984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788832358.190281:0:17238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832358.190887:0:17267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c01228c00/0x998c12b28353837b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283538374 expref: 24 pid: 17244 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832358.190907:0:17267:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17267:1875726218489600:0@lo:104: 00000100:00100000:3.0:1788832358.190921:0:17267:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17267:1875726218489728:0@lo:104: 00010000:00010000:3.0:1788832358.190944:0:17267:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d2b07cff200/0x998c12b2835383f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.191034:0:17238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c00030a00/0x998c12b28353836d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283538366 expref: 23 pid: 17243 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.191044:0:17238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c00030a00/0x998c12b28353836d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283538366 expref: 23 pid: 17243 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.191056:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c00030a00/0x998c12b28353836d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283538366 expref: 23 pid: 17243 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.191068:0:17238:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d2b07cff200/0x998c12b2835383f9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.191077:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2b07cff200/0x998c12b2835383f9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788832358.191091:0:17238:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013856590s 00010000:00010000:2.0:1788832358.191095:0:17238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2b07cff200/0x998c12b2835383f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.191102:0:17238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2b07cff200/0x998c12b2835383f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.191109:0:17238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d2b07cff200/0x998c12b2835383f9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.191116:0:17238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d2b07cff200/0x998c12b2835383f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.191128:0:17238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff200 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832358.191132:0:17238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d2b07cff200/0x998c12b2835383f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.191140:0:17238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d2b07cff200/0x998c12b2835383f9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832358.191923:0:17267:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d2b07cff200/0x998c12b2835383f9 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832358.191933:0:17267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d2b07cff200/0x998c12b2835383f9 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.191964:0:17238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d2b07cff200/0x998c12b2835383f9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.191974:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2b07cff200/0x998c12b2835383f9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832358.191989:0:17238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832358.192043:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e119a26-e2c8-49b5-8e81-f568246f48a1+22:3651:x1875726218489984:12345-0@lo:103:ldlm_bl.0 Request processed in 1770us (1970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832358.192052:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788832358.192097:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e119a26-e2c8-49b5-8e81-f568246f48a1:3651:1875726218489984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788832358.192107:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e119a26-e2c8-49b5-8e81-f568246f48a1:3651:1875726218489856:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1788832358.193558:0:19570:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788832358.195795:0:19570:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788832358.195802:0:19570:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788832358.195835:0:19570:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788832358.195874:0:19570:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788832358.195892:0:19570:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788832358.195910:0:19570:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788832358.199913:0:19570:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788832358.200183:0:19570:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788832358.294788:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788832358.962098:0:19638:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788832358.962404:0:19638:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788832359.318963:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832359.638789:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788832359.638811:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218490112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788832359.638879:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832359.638921:0:18761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218490112 00000100:00100000:0.0:1788832359.638928:0:18761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218490112 00000100:00100000:0.0:1788832359.638975:0:18761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788832359.638984:0:18761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218490112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788832359.639011:0:18761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788832359.639054:0:18761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218490112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832359.639062:0:18761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788832359.639100:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc04380 x1875726218490112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832359.639118:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218490112:0@lo:13:osp-pre-0-1.0 10000000:01000000:2.0:1788832360.023862:0:17247:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788832360.023869:0:17247:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d2c3fc69800 from 10 10000000:01000000:2.0:1788832360.023874:0:17247:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788832360.023920:0:17247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538400 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.023931:0:17247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538400 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.023940:0:17247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538400 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832360.023964:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218490240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788832360.024028:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832360.024073:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36d19180 going to sleep for 11 seconds 00000100:00100000:0.0:1788832360.024101:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218490240 00000100:00100000:0.0:1788832360.024109:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218490240 00000100:00100000:0.0:1788832360.024167:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788832360.024176:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+22:17247:x1875726218490240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832360.024202:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832360.024215:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c1fe0c400/0x998c12b283538407 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283538400 expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.024236:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c1fe0c400/0x998c12b283538407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283538400 expref: 23 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.024246:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c1fe0c400/0x998c12b283538407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283538400 expref: 23 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.024255:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0c400, rc 0) 00000100:00100000:0.0:1788832360.024305:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+23:17247:x1875726218490240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832360.024312:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788832360.024491:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218490240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832360.024506:0:17247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538400 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538407 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.024515:0:17247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538400 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283538407 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832360.024562:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218490368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788832360.024592:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832360.024615:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36d19180 going to sleep for 11 seconds 00000100:00100000:0.0:1788832360.024685:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218490368 00000100:00100000:0.0:1788832360.024689:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218490368 00000100:00100000:0.0:1788832360.024720:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788832360.024726:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+23:17247:x1875726218490368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788832360.024740:0:17244:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788832360.024759:0:17244:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788832360.024762:0:17244:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788832360.024832:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+23:17247:x1875726218490368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832360.024839:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788832360.024909:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218490368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788832360.024963:0:17247:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788832360.024974:0:17247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538400 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538407 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.024981:0:17247:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c01229000/0x998c12b283538400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538407 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832360.024989:0:17247:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788832360.024992:0:17247:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9d2b07d5b800 from 10 10000000:01000000:2.0:1788832360.024994:0:17247:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788832360.025009:0:17247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c01228c00/0x998c12b28353840e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.025016:0:17247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c01228c00/0x998c12b28353840e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.025126:0:17247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c01228c00/0x998c12b28353840e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832360.025141:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218490496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788832360.025167:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832360.025194:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36d19180 going to sleep for 11 seconds 00000100:00100000:2.0:1788832360.025206:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218490496 00000100:00100000:2.0:1788832360.025210:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218490496 00000100:00100000:2.0:1788832360.025232:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788832360.025238:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+23:17247:x1875726218490496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832360.025246:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832360.025254:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c01228400/0x998c12b283538415 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b28353840e expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.025268:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c01228400/0x998c12b283538415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b28353840e expref: 24 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.025357:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c01228400/0x998c12b283538415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b28353840e expref: 24 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.025364:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c01228400, rc 0) 00000100:00100000:2.0:1788832360.025391:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:17247:x1875726218490496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832360.025396:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788832360.025423:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218490496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832360.025432:0:17247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c01228c00/0x998c12b28353840e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538415 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.025440:0:17247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c01228c00/0x998c12b28353840e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283538415 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832360.025478:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218490624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788832360.025504:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832360.025516:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36d19180 going to sleep for 11 seconds 00000100:00100000:2.0:1788832360.025528:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218490624 00000100:00100000:2.0:1788832360.025531:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218490624 00000100:00100000:2.0:1788832360.025547:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788832360.025553:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:17247:x1875726218490624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788832360.025564:0:17244:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788832360.025575:0:17244:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788832360.025578:0:17244:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788832360.025662:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:17247:x1875726218490624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832360.025687:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788832360.025716:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218490624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788832360.025751:0:17247:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788832360.025757:0:17247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c01228c00/0x998c12b28353840e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538415 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.025764:0:17247:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c01228c00/0x998c12b28353840e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538415 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832360.150777:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788832360.150800:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218490752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788832360.150868:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832360.150920:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218490752 00000100:00100000:3.0:1788832360.150927:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218490752 00000100:00100000:3.0:1788832360.150974:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788832360.150983:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218490752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788832360.151015:0:17256:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788832360.151057:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218490752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832360.151064:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788832360.151107:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218490752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788832360.152945:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218490880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788832360.153045:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832360.153158:0:18308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218490880 00000100:00100000:3.0:1788832360.153168:0:18308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218490880 00000100:00100000:3.0:1788832360.153237:0:18308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788832360.153250:0:18308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218490880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788832360.153292:0:18308:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788832360.153367:0:18308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218490880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832360.153377:0:18308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788832360.153899:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218490880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788832360.214708:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788832340/real 1788832340] req@ffff9d2b08550700 x1875726218475904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788832360 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832360.214739:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d2b08550700 x1875726218475904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788832360 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832360.214750:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788832340/real 1788832340] req@ffff9d2b08550000 x1875726218476032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788832360 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832360.214763:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d2b08550000 x1875726218476032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788832360 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788832360.214781:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3d6f6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788832360.215029:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788832360.215034:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218475904:0@lo:8:kworker.0 00000100:00080000:2.0:1788832360.215042:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c0aef0000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788832360.215048:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788832360.215051:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218476032:0@lo:8:kworker.0 00000100:00080000:0.0:1788832360.215232:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788832360.215238:0:14992:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788832360.215241:0:14992:0:(import.c:65:import_set_state_nolock()) ffff9d2c3d6f6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788832360.215247:0:14992:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:0.0:1788832360.215257:0:14992:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788832360.215264:0:14992:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d2c3d6f6000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788832360.215293:0:14992:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c3fc04380 x1875726218491008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788832360.215315:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788832360.215318:0:14992:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788832360.215320:0:14992:0:(import.c:65:import_set_state_nolock()) ffff9d2c0aef0000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788832360.215323:0:14992:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 480 00000100:00080000:0.0:1788832360.215325:0:14992:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788832360.215328:0:14992:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d2c0aef0000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788832360.215336:0:14992:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c3fc07100 x1875726218491136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788832360.215381:0:14992:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788832360.215384:0:14992:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788832360.215386:0:14992:0:(import.c:65:import_set_state_nolock()) ffff9d2c39187000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788832360.215389:0:14992:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d2c39187000 using connection 192.168.203.126@tcp/0@lo 00000100:00100000:0.0:1788832360.215397:0:14992:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d2c3fc05880 x1875726218491520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788832360.215450:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218491392:0@lo:400:kworker.0 00000100:00100000:0.0:1788832360.215510:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832360.215538:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218492032:0@lo:400:kworker.0 00000100:00100000:0.0:1788832360.215560:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832360.215576:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788832360.215580:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218491648:0@lo:400:kworker.0 00000100:00100000:0.0:1788832360.215605:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832360.215617:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218492160:0@lo:400:kworker.0 00000100:00100000:0.0:1788832360.215664:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832360.215702:0:18759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218491392 00000100:00100000:0.0:1788832360.215707:0:18759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218491392 00000100:00100000:0.0:1788832360.215753:0:18759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788832360.215760:0:18759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218491392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832360.215800:0:18759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218491392:12345-0@lo:400:kworker.0 Request processed in 40us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832360.215806:0:18759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788832360.215824:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218492032 00000100:00100000:0.0:1788832360.215826:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218492032 00000100:00100000:0.0:1788832360.215844:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218491648 00000100:00100000:0.0:1788832360.215846:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218491648 00000100:00100000:0.0:1788832360.215854:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218492160 00000100:00100000:0.0:1788832360.215856:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218492160 00000100:00100000:0.0:1788832360.215867:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788832360.215872:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218492032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832360.215896:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218492032:12345-0@lo:400:kworker.0 Request processed in 24us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832360.215902:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788832360.215910:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788832360.215915:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218491648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832360.215934:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218491648:12345-0@lo:400:kworker.0 Request processed in 19us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832360.215939:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788832360.215947:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788832360.215957:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218492160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832360.215979:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218492160:12345-0@lo:400:kworker.0 Request processed in 23us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832360.215985:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788832360.215997:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788832360.216000:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788832360.216002:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788832360.216027:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc06300 x1875726218491648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832360.216040:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218491648:0@lo:400:kworker.0 00010000:00080000:0.0:1788832360.216050:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc05500 x1875726218492160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832360.216057:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218492160:0@lo:400:kworker.0 00010000:00080000:0.0:1788832360.216065:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc04700 x1875726218491392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788832376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832360.216073:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218491392:0@lo:400:kworker.0 00010000:00080000:0.0:1788832360.216082:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc04a80 x1875726218492032/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832360.216089:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218492032:0@lo:400:kworker.0 00000100:00100000:0.0:1788832360.216111:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218491776:0@lo:400:kworker.0 00000100:00100000:0.0:1788832360.216135:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832360.216153:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788832360.216158:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218491264:0@lo:400:kworker.0 00000100:00100000:0.0:1788832360.216175:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832360.216191:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218491904:0@lo:400:kworker.0 00000100:00100000:0.0:1788832360.216206:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832360.216219:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218491776 00000100:00100000:0.0:1788832360.216222:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218491776 00000100:00100000:0.0:1788832360.216239:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218491264 00000100:00100000:0.0:1788832360.216241:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218491264 00000100:00100000:0.0:1788832360.216249:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218491904 00000100:00100000:0.0:1788832360.216251:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218491904 00000100:00100000:0.0:1788832360.216260:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788832360.216265:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218491776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832360.216291:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218491776:12345-0@lo:400:kworker.0 Request processed in 25us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832360.216296:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788832360.216305:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788832360.216309:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218491264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832360.216343:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218491264:12345-0@lo:400:kworker.0 Request processed in 33us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832360.216349:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788832360.216358:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788832360.216363:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218491904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832360.216381:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218491904:12345-0@lo:400:kworker.0 Request processed in 18us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832360.216385:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788832360.216560:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788832360.216565:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788832360.216586:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc05f80 x1875726218491264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832360.216608:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218491264:0@lo:400:kworker.0 00010000:00080000:0.0:1788832360.216645:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc07b80 x1875726218491904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832360.216655:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218491904:0@lo:400:kworker.0 00010000:00080000:0.0:1788832360.216665:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc05c00 x1875726218491776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832360.216681:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218491776:0@lo:400:kworker.0 00000100:00100000:2.0:1788832360.217281:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218491008:0@lo:8:kworker.0 00000100:00100000:2.0:1788832360.217334:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832360.217368:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218491136:0@lo:8:kworker.0 00000100:00100000:2.0:1788832360.217393:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832360.217419:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218491520:0@lo:8:kworker.0 00000100:00100000:2.0:1788832360.217440:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832360.217472:0:18760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218491008 00000100:00100000:2.0:1788832360.217477:0:18760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218491008 00000100:00100000:2.0:1788832360.217498:0:18760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218491136 00000100:00100000:2.0:1788832360.217500:0:18760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218491136 00000100:00100000:2.0:1788832360.217507:0:18760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218491520 00000100:00100000:2.0:1788832360.217509:0:18760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218491520 00000100:00100000:2.0:1788832360.217519:0:18760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788832360.217525:0:18760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1875726218491008:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788832360.217551:0:18760:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:2.0:1788832360.217581:0:18760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x998c12b28353841c 00002000:00100000:2.0:1788832360.217595:0:18760:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9d2b0617d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788832360.217599:0:18760:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788832360.217602:0:18760:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788832360.217718:0:18760:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788832360.217743:0:18760:0:(import.c:65:import_set_state_nolock()) ffff9d2b0617d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832360.217796:0:18760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875726218491008:12345-0@lo:8:kworker.0 Request processed in 269us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832360.217803:0:18760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788832360.217821:0:18760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788832360.217826:0:18760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1875726218491136:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788832360.217846:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc04380 x1875726218491008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788832385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788832360.217854:0:18760:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 500 last 0 00000100:00100000:3.0:1788832360.217860:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788832360.217869:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788832360.217877:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000020:00000080:2.0:1788832360.217878:0:18760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x998c12b283538423 00000100:00080000:3.0:1788832360.217883:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788832360.217887:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c3d6f6000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788832360.217910:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788832360.217915:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218491008:0@lo:8:kworker.0 00000004:00080000:3.0:1788832360.217940:0:17275:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788832360.218013:0:17275:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 500258392305ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788832360.218020:0:17275:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788832360.218247:0:17276:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:0.0:1788832360.218266:0:17276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17276:1875726218492416:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788832360.218298:0:17276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832360.218315:0:17276:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b0657d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788832360.218398:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788832360.218409:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218492288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788832360.218449:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832360.218482:0:18761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218492288 00000100:00100000:3.0:1788832360.218487:0:18761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218492288 00000100:00100000:3.0:1788832360.218529:0:18761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788832360.218544:0:18761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875726218492288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788832360.218559:0:18761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788832360.218597:0:18761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1875726218492288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832360.218604:0:18761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788832360.218653:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788832360.218685:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc05c00 x1875726218492288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832360.218706:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218492288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788832360.218732:0:18759:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788832360.218738:0:18759:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788832360.218858:0:18759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218492416 00000100:00100000:3.0:1788832360.218862:0:18759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218492416 00000100:00100000:3.0:1788832360.218951:0:19714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788832360.218957:0:19714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3650:x1875726218491520:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788832360.218980:0:19714:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:3.0:1788832360.219009:0:19714:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x998c12b28353842a 00002000:00100000:3.0:1788832360.219021:0:19714:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9d2b010f8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788832360.219025:0:19714:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788832360.219028:0:19714:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788832360.219179:0:19714:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788832360.219201:0:19714:0:(import.c:65:import_set_state_nolock()) ffff9d2b010fd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788832360.219243:0:19714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3650:x1875726218491520:12345-0@lo:8:kworker.0 Request processed in 284us (1802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832360.219249:0:19714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788832360.219277:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc05880 x1875726218491520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788832385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788832360.219295:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788832360.219302:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788832360.219306:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788832360.219309:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c39187000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788832360.219326:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788832360.219331:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1875726218491520:0@lo:8:kworker.0 00000004:00080000:3.0:1788832360.219366:0:17996:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788832360.219380:0:17996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08553480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17996:1875726218492672:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788832360.219404:0:17996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832360.219416:0:17996:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c35803600 going to sleep for 11 seconds 00000100:00100000:3.0:1788832360.219425:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218492544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788832360.219442:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832360.219465:0:18759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218492672 00000100:00100000:3.0:1788832360.219469:0:18759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218492672 00002000:00100000:2.0:1788832360.219478:0:18760:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9d2b0617c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396e ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788832360.219485:0:18760:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788832360.219487:0:18760:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788832360.219495:0:18759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788832360.219502:0:18759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17276:x1875726218492416:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788832360.219524:0:18760:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788832360.219542:0:18760:0:(import.c:65:import_set_state_nolock()) ffff9d2b06016800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832360.219588:0:18760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875726218491136:12345-0@lo:8:kworker.0 Request processed in 1759us (2192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832360.219595:0:18760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788832360.219612:0:18760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788832360.219643:0:18760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17996:x1875726218492672:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788832360.219732:0:18761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218492544 00000100:00100000:3.0:1788832360.219736:0:18761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218492544 00000100:00100000:3.0:1788832360.219758:0:18761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788832360.219764:0:18761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3652:x1875726218492544:12345-0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788832360.219801:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc07100 x1875726218491136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788832385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832360.219810:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788832360.219815:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788832360.219821:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788832360.219824:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788832360.219826:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9d2c0aef0000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788832360.219839:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788832360.219843:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1875726218491136:0@lo:8:kworker.0 00000004:00080000:1.0:1788832360.220591:0:17995:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788832360.220794:0:17995:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 500261172180ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788832360.220802:0:17995:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1788832360.221967:0:17278:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1788832360.222009:0:17278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17278:1875726218492928:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788832360.222068:0:17278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832360.222097:0:17278:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c36d19a80 going to sleep for 11 seconds 00000004:00080000:2.0:1788832360.222127:0:17277:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788832360.222196:0:17277:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 500262574404ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788832360.222202:0:17277:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788832360.222217:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788832360.222229:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218492800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832360.222257:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832360.222280:0:18758:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788832360.222287:0:18758:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00000024:3.0:1788832360.222574:0:18761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788832360.222642:0:18761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3652:x1875726218492544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2876us (3196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832360.222653:0:18761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788832360.222687:0:18758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218492928 00000100:00100000:3.0:1788832360.222691:0:18761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218492800 00000100:00100000:2.0:1788832360.222695:0:18758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218492928 00000100:00100000:3.0:1788832360.222702:0:18761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218492800 00000100:00100000:3.0:1788832360.222733:0:18761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788832360.222741:0:18761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1875726218492800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788832360.222759:0:18761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788832360.222795:0:18761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3654:x1875726218492800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832360.222801:0:18761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788832360.222821:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788832360.222826:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcb4700 x1875726218492800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832360.222848:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218492800:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788832360.222866:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b08552d80 x1875726218492544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788832376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832360.222880:0:19715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788832360.222883:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218492544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788832360.222893:0:19715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17278:x1875726218492928:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788832360.225075:0:17985:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:3.0:1788832360.227599:0:17231:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:2.0:1788832360.231069:0:18759:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788832360.231081:0:18759:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788832360.231087:0:18759:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:3.0:1788832360.233288:0:17231:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788832360.247118:0:19715:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788832360.247128:0:19715:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788832360.247134:0:19715:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00080000:1.0:1788832360.248003:0:18760:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788832360.248011:0:18760:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788832360.248105:0:18760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17996:x1875726218492672:12345-0@lo:7:osp-pre-1-1.0 Request processed in 28482us (28696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832360.248115:0:18760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788832360.248179:0:17996:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b08553480 x1875726218492672/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788832376 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832360.248194:0:17996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08553480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17996:1875726218492672:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788832360.248207:0:17996:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788832360.248247:0:17996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17996:1875726218493056:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788832360.248279:0:17996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832360.248307:0:17996:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0760f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788832360.248431:0:18758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218493056 00000100:00100000:2.0:1788832360.248438:0:18758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218493056 00000100:00100000:2.0:1788832360.248481:0:18758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788832360.248491:0:18758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17996:x1875726218493056:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788832360.248516:0:18758:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1788832360.248558:0:18758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17996:x1875726218493056:12345-0@lo:5:osp-pre-1-1.0 Request processed in 70us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832360.248564:0:18758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788832360.248831:0:17996:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b0771d500 x1875726218493056/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788832376 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832360.248842:0:17996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17996:1875726218493056:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788832360.248852:0:17996:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788832360.248883:0:17996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17996:1875726218493184:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788832360.248909:0:17996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832360.248925:0:17996:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0760f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788832360.248944:0:18760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218493184 00000100:00100000:1.0:1788832360.248948:0:18760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218493184 00000100:00100000:1.0:1788832360.248982:0:18760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788832360.248987:0:18758:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:1.0:1788832360.248990:0:18760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17996:x1875726218493184:12345-0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788832360.249008:0:18758:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00002000:00080000:1.0:1788832360.249018:0:18760:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:2.0:1788832360.254319:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788832360.254334:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eef0ec67/0x998c12b283538431 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.254351:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788832360.254355:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832360.254362:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eef0ec67/0x998c12b283538431 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.254381:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eef0ec67/0x998c12b283538431 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.254393:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eef0ec67/0x998c12b283538431 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.254401:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eef0ec67/0x998c12b283538431 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.254420:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832360.254433:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.254438:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eef0ec67/0x998c12b283538431 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.254446:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01228e00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.254450:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eef0ec67/0x998c12b283538431 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.254472:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eef0ec67/0x998c12b283538431 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.254487:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eef0ec67/0x998c12b283538431 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.254495:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eef0ec67/0x998c12b283538431 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.254511:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.254512:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.254514:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788832360.256204:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788832360.256213:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a844adca/0x998c12b283538438 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.256227:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788832360.256230:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832360.256236:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a844adca/0x998c12b283538438 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.256248:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a844adca/0x998c12b283538438 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.256256:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a844adca/0x998c12b283538438 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.256270:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a844adca/0x998c12b283538438 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.256287:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832360.256298:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.256303:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a844adca/0x998c12b283538438 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.256310:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01229c00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.256314:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a844adca/0x998c12b283538438 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.256325:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a844adca/0x998c12b283538438 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.256339:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a844adca/0x998c12b283538438 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.256347:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a844adca/0x998c12b283538438 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.256361:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.256363:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.256366:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788832360.259182:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788832360.259209:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016962f3c/0x998c12b28353843f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.259226:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788832360.259231:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832360.259237:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016962f3c/0x998c12b28353843f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.259250:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016962f3c/0x998c12b28353843f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.259261:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016962f3c/0x998c12b28353843f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.259267:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016962f3c/0x998c12b28353843f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.259285:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832360.259296:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.259301:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016962f3c/0x998c12b28353843f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.259309:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01229800 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.259313:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016962f3c/0x998c12b28353843f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.259322:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016962f3c/0x998c12b28353843f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.259346:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016962f3c/0x998c12b28353843f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.259353:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016962f3c/0x998c12b28353843f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.259370:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.259373:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.259375:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788832360.260507:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788832360.260516:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6839f72/0x998c12b283538446 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.260528:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788832360.260532:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832360.260537:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6839f72/0x998c12b283538446 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.260547:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6839f72/0x998c12b283538446 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.260555:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6839f72/0x998c12b283538446 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.260562:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6839f72/0x998c12b283538446 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.260590:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832360.260599:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.260604:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6839f72/0x998c12b283538446 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.260612:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01228200 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.260616:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6839f72/0x998c12b283538446 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.260642:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6839f72/0x998c12b283538446 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.260657:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6839f72/0x998c12b283538446 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.260664:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6839f72/0x998c12b283538446 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.260686:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.260688:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.260690:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788832360.263001:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788832360.263015:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057001f27/0x998c12b28353844d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.263032:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788832360.263044:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832360.263051:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057001f27/0x998c12b28353844d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.263066:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057001f27/0x998c12b28353844d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.263076:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057001f27/0x998c12b28353844d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.263083:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057001f27/0x998c12b28353844d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.263120:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832360.263131:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.263137:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057001f27/0x998c12b28353844d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.263146:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01229600 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.263149:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057001f27/0x998c12b28353844d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.263157:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057001f27/0x998c12b28353844d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.263173:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057001f27/0x998c12b28353844d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.263191:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057001f27/0x998c12b28353844d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.263209:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.263211:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.263213:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788832360.265073:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788832360.265084:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283538454 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.265100:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788832360.265105:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832360.265111:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283538454 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.265124:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283538454 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.265134:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283538454 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.265142:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283538454 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.265161:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832360.265173:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.265186:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283538454 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.265194:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01228000 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.265198:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283538454 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.265206:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283538454 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.265222:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283538454 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.265229:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000392a7ad3/0x998c12b283538454 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.265245:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.265246:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.265248:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788832360.267130:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788832360.267140:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089079910/0x998c12b28353845b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.267155:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788832360.267160:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832360.267166:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089079910/0x998c12b28353845b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.267191:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089079910/0x998c12b28353845b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.267202:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089079910/0x998c12b28353845b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.267210:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089079910/0x998c12b28353845b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.267227:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832360.267238:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.267243:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089079910/0x998c12b28353845b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.267250:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01228800 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.267254:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089079910/0x998c12b28353845b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.267262:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089079910/0x998c12b28353845b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.267283:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089079910/0x998c12b28353845b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.267289:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089079910/0x998c12b28353845b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.267310:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.267312:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.267315:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788832360.272016:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832360.272029:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d82f700/0x998c12b283538462 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.272044:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788832360.272048:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832360.272054:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d82f700/0x998c12b283538462 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.272068:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d82f700/0x998c12b283538462 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.272079:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d82f700/0x998c12b283538462 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.272086:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d82f700/0x998c12b283538462 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.272107:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832360.272505:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.272514:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d82f700/0x998c12b283538462 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.272524:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff000 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.272529:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d82f700/0x998c12b283538462 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.272539:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d82f700/0x998c12b283538462 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.272559:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d82f700/0x998c12b283538462 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.272566:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d82f700/0x998c12b283538462 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.272586:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.272589:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.272592:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788832360.272732:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832360.272738:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb9e67e8/0x998c12b283538469 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.272756:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788832360.272760:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832360.272764:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb9e67e8/0x998c12b283538469 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.272773:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb9e67e8/0x998c12b283538469 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.272780:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb9e67e8/0x998c12b283538469 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.272787:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb9e67e8/0x998c12b283538469 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.272802:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788832360.273148:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832360.273154:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d345b13/0x998c12b283538470 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.273162:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788832360.273166:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832360.273170:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d345b13/0x998c12b283538470 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.273179:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d345b13/0x998c12b283538470 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.273197:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d345b13/0x998c12b283538470 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.273204:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d345b13/0x998c12b283538470 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.273215:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788832360.273603:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832360.273610:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f5c2618/0x998c12b283538477 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.273618:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788832360.273643:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832360.273647:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f5c2618/0x998c12b283538477 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.273655:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f5c2618/0x998c12b283538477 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.273663:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f5c2618/0x998c12b283538477 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.273669:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f5c2618/0x998c12b283538477 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.273703:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788832360.274722:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788832360.274731:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb9e67e8/0x998c12b283538469 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.274754:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfec00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.274759:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb9e67e8/0x998c12b283538469 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.274769:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb9e67e8/0x998c12b283538469 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.274786:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb9e67e8/0x998c12b283538469 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.274794:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb9e67e8/0x998c12b283538469 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.274814:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788832360.274817:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d345b13/0x998c12b283538470 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.274823:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe800 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.274828:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d345b13/0x998c12b283538470 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.274835:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d345b13/0x998c12b283538470 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.274845:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d345b13/0x998c12b283538470 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.274861:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d345b13/0x998c12b283538470 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.274876:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.274880:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f5c2618/0x998c12b283538477 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.274887:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff200 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.274891:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f5c2618/0x998c12b283538477 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.274898:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f5c2618/0x998c12b283538477 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.274910:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f5c2618/0x998c12b283538477 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.274917:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f5c2618/0x998c12b283538477 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.274931:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.274934:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.274935:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.274941:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788832360.277979:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832360.277991:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bf5db08/0x998c12b28353847e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.278007:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788832360.278011:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832360.278016:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bf5db08/0x998c12b28353847e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.278029:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bf5db08/0x998c12b28353847e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.278039:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bf5db08/0x998c12b28353847e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.278046:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bf5db08/0x998c12b28353847e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.278061:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788832360.279979:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832360.279990:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5734df9/0x998c12b283538485 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.280005:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788832360.280018:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832360.280024:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5734df9/0x998c12b283538485 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.280036:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5734df9/0x998c12b283538485 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.280046:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5734df9/0x998c12b283538485 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.280053:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5734df9/0x998c12b283538485 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.280068:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788832360.281004:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788832360.281014:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bf5db08/0x998c12b28353847e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.281030:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe400 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.281036:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bf5db08/0x998c12b28353847e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.281046:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bf5db08/0x998c12b28353847e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.281064:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bf5db08/0x998c12b28353847e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.281070:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bf5db08/0x998c12b28353847e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.281090:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.281094:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5734df9/0x998c12b283538485 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.281100:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff800 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.281103:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5734df9/0x998c12b283538485 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.281110:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5734df9/0x998c12b283538485 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.281119:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5734df9/0x998c12b283538485 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.281131:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5734df9/0x998c12b283538485 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.281143:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.281145:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.281146:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.281153:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788832360.281499:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.281506:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b28353848c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.281518:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.281522:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.281527:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b28353848c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.281541:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b28353848c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.281561:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b28353848c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.281568:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b28353848c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.281583:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788832360.281815:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832360.281822:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000138fb9fd/0x998c12b283538493 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.281831:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788832360.281835:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832360.281840:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000138fb9fd/0x998c12b283538493 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.281849:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000138fb9fd/0x998c12b283538493 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.281857:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000138fb9fd/0x998c12b283538493 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.281870:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000138fb9fd/0x998c12b283538493 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.281882:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788832360.283541:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.283553:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b28353849a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.283566:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.283571:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.283577:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b28353849a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.283589:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b28353849a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.283598:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b28353849a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.283605:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b28353849a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.283647:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788832360.284050:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788832360.284058:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b28353848c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.284066:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031400 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.284071:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b28353848c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.284078:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b28353848c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.284095:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b28353848c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.284102:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b28353848c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.284122:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788832360.284126:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000138fb9fd/0x998c12b283538493 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.284138:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c3050a400 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.284141:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000138fb9fd/0x998c12b283538493 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.284148:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000138fb9fd/0x998c12b283538493 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.284160:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000138fb9fd/0x998c12b283538493 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.284166:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000138fb9fd/0x998c12b283538493 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.284178:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.284181:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b28353849a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.284187:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031000 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.284189:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b28353849a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.284196:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b28353849a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.284205:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b28353849a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.284216:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b28353849a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.284230:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.284232:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.284233:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.284241:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788832360.285280:0:19571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788832360.285293:0:19571:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788832360.285299:0:19571:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788832360.285450:0:18760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17996:x1875726218493184:12345-0@lo:5:osp-pre-1-1.0 Request processed in 36457us (36536us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788832360.285461:0:18760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788832360.285518:0:17996:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788832360.285526:0:17996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17996:1875726218493184:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788832360.285542:0:17996:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788832360.285592:0:17996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17996:1875726218493312:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788832360.285649:0:17996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832360.285680:0:17996:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788832360.285700:0:17263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218493312 00000100:00100000:2.0:1788832360.285706:0:17263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218493312 00000100:00100000:2.0:1788832360.285747:0:17263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788832360.285754:0:17263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17996:x1875726218493312:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788832360.285799:0:17263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17996:x1875726218493312:12345-0@lo:900:osp-pre-1-1.0 Request processed in 46us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832360.285818:0:17263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788832360.285850:0:17996:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcb4700 x1875726218493312/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788832376 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832360.285860:0:17996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17996:1875726218493312:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1788832360.289290:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832360.289305:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7659b05/0x998c12b2835384a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.289322:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788832360.289326:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832360.289332:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7659b05/0x998c12b2835384a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.289347:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7659b05/0x998c12b2835384a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.289356:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7659b05/0x998c12b2835384a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.289363:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7659b05/0x998c12b2835384a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.289499:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832360.289541:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.289550:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7659b05/0x998c12b2835384a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.289560:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c3050bc00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.289565:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7659b05/0x998c12b2835384a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.289574:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7659b05/0x998c12b2835384a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.289593:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7659b05/0x998c12b2835384a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.289609:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7659b05/0x998c12b2835384a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.289662:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.289664:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.289666:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788832360.289969:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788832360.289977:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a69c0f03/0x998c12b2835384a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.289988:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=500s v=(0 0) 00010000:00010000:0.0:1788832360.289992:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832360.289997:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a69c0f03/0x998c12b2835384a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.290011:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a69c0f03/0x998c12b2835384a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.290019:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a69c0f03/0x998c12b2835384a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.290033:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a69c0f03/0x998c12b2835384a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.290054:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832360.290095:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.290103:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a69c0f03/0x998c12b2835384a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.290119:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0da00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.290122:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a69c0f03/0x998c12b2835384a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.290130:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a69c0f03/0x998c12b2835384a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.290141:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a69c0f03/0x998c12b2835384a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.290148:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a69c0f03/0x998c12b2835384a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.290165:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.290167:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.290169:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788832360.290394:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832360.290402:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f3eb4b8/0x998c12b2835384af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.290421:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788832360.290575:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832360.290581:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f3eb4b8/0x998c12b2835384af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.290592:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f3eb4b8/0x998c12b2835384af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.290601:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f3eb4b8/0x998c12b2835384af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.290608:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f3eb4b8/0x998c12b2835384af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.290639:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832360.290687:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.290693:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f3eb4b8/0x998c12b2835384af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.290701:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c3050b800 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.290706:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f3eb4b8/0x998c12b2835384af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.290714:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f3eb4b8/0x998c12b2835384af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.290738:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f3eb4b8/0x998c12b2835384af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.290745:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f3eb4b8/0x998c12b2835384af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.290759:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.290761:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.290763:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788832360.291807:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788832360.291817:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000123c0521/0x998c12b2835384b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.291830:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=500s v=(0 0) 00010000:00010000:0.0:1788832360.291834:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832360.291839:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000123c0521/0x998c12b2835384b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.291852:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000123c0521/0x998c12b2835384b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.291862:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000123c0521/0x998c12b2835384b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.291869:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000123c0521/0x998c12b2835384b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.291895:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788832360.292318:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832360.292324:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055c948e4/0x998c12b2835384bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.292334:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788832360.292337:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832360.292341:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055c948e4/0x998c12b2835384bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.292352:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055c948e4/0x998c12b2835384bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.292372:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055c948e4/0x998c12b2835384bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.292390:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055c948e4/0x998c12b2835384bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.292413:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788832360.292507:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788832360.292516:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000123c0521/0x998c12b2835384b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.292525:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0cc00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:3.0:1788832360.292528:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000123c0521/0x998c12b2835384b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.292536:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000123c0521/0x998c12b2835384b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.292552:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000123c0521/0x998c12b2835384b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.292558:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000123c0521/0x998c12b2835384b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.292586:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832360.292591:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055c948e4/0x998c12b2835384bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.292597:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c3050a600 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:3.0:1788832360.292601:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055c948e4/0x998c12b2835384bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.292657:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055c948e4/0x998c12b2835384bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.292684:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055c948e4/0x998c12b2835384bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.292692:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055c948e4/0x998c12b2835384bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.292714:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832360.292716:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832360.292718:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.292745:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788832360.292938:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832360.292945:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063662a6d/0x998c12b2835384c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.292955:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788832360.292959:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832360.292963:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063662a6d/0x998c12b2835384c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.292972:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063662a6d/0x998c12b2835384c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.292991:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063662a6d/0x998c12b2835384c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.292999:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063662a6d/0x998c12b2835384c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.293030:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788832360.293066:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832360.293072:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063662a6d/0x998c12b2835384c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.293080:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c3050b200 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:3.0:1788832360.293084:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063662a6d/0x998c12b2835384c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.293094:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063662a6d/0x998c12b2835384c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.293106:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063662a6d/0x998c12b2835384c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.293138:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063662a6d/0x998c12b2835384c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.293154:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832360.293157:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832360.293158:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788832360.293719:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.293728:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f193762/0x998c12b2835384cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.293738:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.293743:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.293748:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f193762/0x998c12b2835384cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.293759:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f193762/0x998c12b2835384cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.293768:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f193762/0x998c12b2835384cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.293776:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f193762/0x998c12b2835384cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.293793:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788832360.293988:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832360.293994:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd970481/0x998c12b2835384d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.294003:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788832360.294007:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832360.294011:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd970481/0x998c12b2835384d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.294022:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd970481/0x998c12b2835384d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.294030:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd970481/0x998c12b2835384d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.294038:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd970481/0x998c12b2835384d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.294058:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788832360.294179:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788832360.294186:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f193762/0x998c12b2835384cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.294197:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031c00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.294201:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f193762/0x998c12b2835384cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.294210:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f193762/0x998c12b2835384cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.294224:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f193762/0x998c12b2835384cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.294232:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f193762/0x998c12b2835384cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.294262:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.294266:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd970481/0x998c12b2835384d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.294279:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c3050ae00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.294282:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd970481/0x998c12b2835384d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.294291:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd970481/0x998c12b2835384d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.294301:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd970481/0x998c12b2835384d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.294310:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd970481/0x998c12b2835384d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.294321:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.294323:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.294325:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832360.294448:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788832360.294496:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.294501:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b2835384d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.294509:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.294512:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.294516:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b2835384d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.294525:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b2835384d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.294533:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b2835384d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.294539:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b2835384d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.294559:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832360.294683:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.294688:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b2835384d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.294695:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031e00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.294705:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b2835384d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.294714:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b2835384d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.294725:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b2835384d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.294732:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b2835384d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.294747:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.294749:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.294751:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788832360.294779:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832360.294786:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d5de2bc/0x998c12b2835384e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.294794:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788832360.294803:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832360.294856:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d5de2bc/0x998c12b2835384e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.294867:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d5de2bc/0x998c12b2835384e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.294875:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d5de2bc/0x998c12b2835384e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.294881:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d5de2bc/0x998c12b2835384e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.294903:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788832360.295004:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.295010:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b2835384e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.295018:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.295020:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.295024:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b2835384e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.295043:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b2835384e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.295052:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b2835384e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.295059:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b2835384e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.295071:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788832360.295521:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832360.295527:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000677068aa/0x998c12b2835384ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.295536:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788832360.295538:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832360.295542:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000677068aa/0x998c12b2835384ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.295551:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000677068aa/0x998c12b2835384ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.295558:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788832360.295560:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000677068aa/0x998c12b2835384ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.295567:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d5de2bc/0x998c12b2835384e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.295587:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c3050a800 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:1.0:1788832360.295588:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000677068aa/0x998c12b2835384ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.295592:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d5de2bc/0x998c12b2835384e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.295603:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788832360.295607:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d5de2bc/0x998c12b2835384e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.295648:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d5de2bc/0x998c12b2835384e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.295663:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d5de2bc/0x998c12b2835384e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.295691:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788832360.295696:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b2835384e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.295704:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030c00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.295708:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b2835384e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.295716:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b2835384e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.295728:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b2835384e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.295737:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b2835384e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.295752:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.295755:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000677068aa/0x998c12b2835384ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.295762:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c3050a000 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.295771:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000677068aa/0x998c12b2835384ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.295779:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000677068aa/0x998c12b2835384ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.295790:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000677068aa/0x998c12b2835384ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.295798:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000677068aa/0x998c12b2835384ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.295809:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.295811:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.295813:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.295820:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788832360.295996:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832360.296001:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000135d8cc9/0x998c12b2835384f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.296009:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788832360.296011:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832360.296015:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000135d8cc9/0x998c12b2835384f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.296023:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000135d8cc9/0x998c12b2835384f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.296030:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000135d8cc9/0x998c12b2835384f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.296036:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000135d8cc9/0x998c12b2835384f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788832360.296372:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.296378:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b2835384fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.296386:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.296388:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.296392:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b2835384fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.296401:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b2835384fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.296409:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b2835384fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.296476:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832360.296532:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.296539:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000135d8cc9/0x998c12b2835384f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.296547:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c3050ba00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.296550:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000135d8cc9/0x998c12b2835384f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.296558:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000135d8cc9/0x998c12b2835384f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.296570:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000135d8cc9/0x998c12b2835384f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.296584:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000135d8cc9/0x998c12b2835384f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.296598:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.296600:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.296602:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832360.296827:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b2835384fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.296933:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788832360.296942:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832360.296948:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b2835384fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.296956:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030600 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:3.0:1788832360.296960:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b2835384fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.296969:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b2835384fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.296982:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b2835384fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.296990:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b2835384fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.297005:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832360.297007:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832360.297008:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788832360.297030:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832360.297037:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b9c885a/0x998c12b283538503 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.297058:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788832360.297062:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832360.297066:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b9c885a/0x998c12b283538503 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.297075:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b9c885a/0x998c12b283538503 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.297082:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b9c885a/0x998c12b283538503 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.297088:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b9c885a/0x998c12b283538503 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.297230:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788832360.297585:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832360.297591:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0ecd0a2/0x998c12b28353850a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.297600:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788832360.297603:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832360.297606:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0ecd0a2/0x998c12b28353850a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.297615:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0ecd0a2/0x998c12b28353850a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.297738:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0ecd0a2/0x998c12b28353850a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.297744:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0ecd0a2/0x998c12b28353850a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.300118:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788832360.300815:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788832360.300825:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b9c885a/0x998c12b283538503 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.300843:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c3050be00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:3.0:1788832360.300848:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b9c885a/0x998c12b283538503 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.300858:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b9c885a/0x998c12b283538503 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.300877:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b9c885a/0x998c12b283538503 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.300885:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b9c885a/0x998c12b283538503 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.301188:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832360.301193:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0ecd0a2/0x998c12b28353850a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.301199:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c3050b600 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:3.0:1788832360.301202:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0ecd0a2/0x998c12b28353850a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.301209:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0ecd0a2/0x998c12b28353850a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.301220:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0ecd0a2/0x998c12b28353850a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.301233:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0ecd0a2/0x998c12b28353850a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.301246:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832360.301247:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832360.301249:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788832360.301379:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832360.301387:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014395bdd/0x998c12b283538511 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.301399:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788832360.301404:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832360.301410:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014395bdd/0x998c12b283538511 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.301425:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014395bdd/0x998c12b283538511 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.301435:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014395bdd/0x998c12b283538511 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.301443:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014395bdd/0x998c12b283538511 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.301465:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788832360.302018:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832360.302024:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f45be5e/0x998c12b283538518 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.302033:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788832360.302036:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832360.302040:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f45be5e/0x998c12b283538518 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.302049:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f45be5e/0x998c12b283538518 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.302056:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f45be5e/0x998c12b283538518 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.302062:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f45be5e/0x998c12b283538518 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.302084:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788832360.302382:0:18759:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788832360.302389:0:18759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ae67926/0x998c12b28353851f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.302396:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1788832360.302405:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788832360.302409:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ae67926/0x998c12b28353851f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.302418:0:18759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ae67926/0x998c12b28353851f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.302425:0:18759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ae67926/0x998c12b28353851f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.302431:0:18759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ae67926/0x998c12b28353851f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832360.302439:0:18759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:1.0:1788832360.302468:0:18759:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:1.0:1788832360.302568:0:18759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17276:x1875726218492416:12345-0@lo:5:osp-pre-0-0.0 Request processed in 83061us (84265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832360.302579:0:18759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788832360.302606:0:17276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17276:1875726218492416:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788832360.302639:0:17276:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00010000:00010000:3.0:1788832360.302711:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788832360.302717:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014395bdd/0x998c12b283538511 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.302724:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c3050b000 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:3.0:1788832360.302728:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014395bdd/0x998c12b283538511 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.302736:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014395bdd/0x998c12b283538511 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.302749:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014395bdd/0x998c12b283538511 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.302756:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014395bdd/0x998c12b283538511 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.302771:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788832360.302775:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f45be5e/0x998c12b283538518 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.302787:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c3050ac00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:3.0:1788832360.302791:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f45be5e/0x998c12b283538518 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.302798:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f45be5e/0x998c12b283538518 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.302809:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f45be5e/0x998c12b283538518 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.302816:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f45be5e/0x998c12b283538518 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.302830:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788832360.302833:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ae67926/0x998c12b28353851f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.302838:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c3050aa00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:3.0:1788832360.302841:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ae67926/0x998c12b28353851f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.302847:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ae67926/0x998c12b28353851f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.302855:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ae67926/0x998c12b28353851f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.302869:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ae67926/0x998c12b28353851f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.302881:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832360.302882:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832360.302884:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832360.303026:0:17276:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17276:1875726218493440:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788832360.303067:0:17276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832360.303105:0:17276:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c011ca3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832360.303162:0:19714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218493440 00000100:00100000:0.0:1788832360.303169:0:19714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218493440 00000100:00100000:0.0:1788832360.303214:0:19714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788832360.303223:0:19714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17276:x1875726218493440:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788832360.303256:0:19714:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:2.0:1788832360.307912:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.307920:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788832360.308520:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.308532:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6f68271/0x998c12b283538526 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.308549:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.308553:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.308559:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6f68271/0x998c12b283538526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.308574:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6f68271/0x998c12b283538526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.308585:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6f68271/0x998c12b283538526 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.308591:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6f68271/0x998c12b283538526 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.309199:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832360.309266:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.309283:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6f68271/0x998c12b283538526 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.309294:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031600 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.309298:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6f68271/0x998c12b283538526 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.309308:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6f68271/0x998c12b283538526 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.309325:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6f68271/0x998c12b283538526 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.309332:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6f68271/0x998c12b283538526 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.309362:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.309364:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.309366:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788832360.309789:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.309804:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b28353852d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.309814:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.309819:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.309824:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b28353852d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.309836:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b28353852d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.309845:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b28353852d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.309853:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b28353852d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.310396:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788832360.316291:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.316305:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b283538534 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.316323:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.316328:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.316335:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b283538534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.316350:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b283538534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.316375:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b283538534 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.316382:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b283538534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788832360.319069:0:18754:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1788832360.319112:0:18754:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788832360.319347:0:19714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17276:x1875726218493440:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16118us (16274us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788832360.319358:0:19714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788832360.319452:0:17276:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788832360.319461:0:17276:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17276:1875726218493440:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788832360.319476:0:17276:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:2.0:1788832360.319748:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788832360.320868:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832360.322015:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b28353852d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.322044:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030600 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.322049:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b28353852d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.322062:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b28353852d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.322086:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b28353852d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.322095:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b28353852d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.322126:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.322131:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b283538534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.322138:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031000 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.322155:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b283538534 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.322156:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.322179:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b283538534 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.322191:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b283538534 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.322199:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b283538534 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.322215:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.322217:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.322219:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788832360.323313:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.323323:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b28353853b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.323339:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.323344:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.323350:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b28353853b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.323362:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b28353853b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.323371:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b28353853b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.323378:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b28353853b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.323417:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788832360.323507:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832360.323513:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b28353853b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.323520:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031400 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:0.0:1788832360.323523:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b28353853b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.323530:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b28353853b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788832360.324473:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.324481:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b283538542 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.324492:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.324496:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.324500:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b283538542 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.324510:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b283538542 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.324518:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b283538542 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.324525:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b283538542 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.324614:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b28353853b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.324639:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b28353853b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.324667:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832360.324680:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b283538542 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.324689:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030a00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:0.0:1788832360.324693:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b283538542 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.324701:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b283538542 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.324712:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b283538542 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.324719:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832360.324722:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832360.325345:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788832360.325352:0:19715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b283538542 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788832360.329523:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.329537:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b283538549 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.329567:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.329571:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.329578:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b283538549 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.329597:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b283538549 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.329608:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b283538549 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.329636:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b283538549 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.331454:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.331481:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b283538549 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.331495:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030c00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.331501:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b283538549 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.331512:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b283538549 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.331540:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b283538549 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.331567:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.331569:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.331571:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832360.331617:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.335211:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832360.335356:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788832360.335367:0:19715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b283538549 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788832360.339432:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.339446:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283538550 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.339463:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.339468:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.339474:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283538550 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.339507:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283538550 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.339518:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283538550 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.339526:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283538550 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.339552:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832360.339844:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.339852:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283538550 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.339861:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031e00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.339865:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283538550 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.339874:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283538550 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.339889:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283538550 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.339897:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c61cb1c/0x998c12b283538550 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.339915:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.339916:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.339918:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788832360.341836:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.341849:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f193762/0x998c12b283538557 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.341864:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.341869:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.341875:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f193762/0x998c12b283538557 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.341887:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f193762/0x998c12b283538557 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.341897:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f193762/0x998c12b283538557 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.341917:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f193762/0x998c12b283538557 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.341936:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832360.342171:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.342178:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f193762/0x998c12b283538557 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.342193:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031c00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.342198:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f193762/0x998c12b283538557 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.342207:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f193762/0x998c12b283538557 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.342224:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f193762/0x998c12b283538557 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.342232:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f193762/0x998c12b283538557 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.342250:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.342251:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.342253:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788832360.342834:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.342841:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b28353855e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.342850:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.342854:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.342858:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b28353855e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.342869:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b28353855e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.342877:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b28353855e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.342884:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b28353855e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.342906:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832360.343040:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.343046:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b28353855e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.343054:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030a00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.343058:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b28353855e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.343065:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b28353855e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.343085:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b28353855e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.343092:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b28353855e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.343106:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.343108:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.343110:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788832360.343769:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.343776:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b283538565 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.343791:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.343795:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.343799:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b283538565 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.343809:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b283538565 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.343818:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b283538565 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.343826:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b283538565 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.343847:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788832360.347600:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.347614:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b28353856c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.347646:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.347651:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.347656:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b28353856c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.347669:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b28353856c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.347711:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b28353856c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.347719:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b28353856c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.347923:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788832360.347932:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b283538565 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.347941:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031400 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:0.0:1788832360.347945:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b283538565 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.347968:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b283538565 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.347986:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b283538565 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.347993:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3f086e1/0x998c12b283538565 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.348015:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832360.348019:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b28353856c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.348025:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031000 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:0.0:1788832360.348029:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b28353856c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.348036:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b28353856c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.348046:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b28353856c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.348054:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832360.348056:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832360.348064:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.349265:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832360.349395:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788832360.349403:0:19715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b28353856c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.349658:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788832360.350729:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.350741:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b283538573 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.350756:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.350760:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.350767:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b283538573 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.350779:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b283538573 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.350789:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b283538573 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.350808:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b283538573 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.350833:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788832360.351282:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832360.351290:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b283538573 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.351299:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030c00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:0.0:1788832360.351304:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b283538573 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.351314:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b283538573 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.351331:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b283538573 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.351338:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5b5dc25/0x998c12b283538573 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.351355:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832360.351357:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832360.351359:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788832360.351445:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.351452:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b28353857a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.351460:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.351464:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.351467:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b28353857a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.351476:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b28353857a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.351483:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b28353857a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.351491:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b28353857a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.351510:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788832360.351661:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832360.351667:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b28353857a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.351687:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030600 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:0.0:1788832360.351690:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b28353857a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.351704:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b28353857a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.351716:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b28353857a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.351722:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091a2b1bd/0x998c12b28353857a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788832360.351916:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.351923:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6f68271/0x998c12b283538581 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.351937:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.351941:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.351946:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6f68271/0x998c12b283538581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.351956:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6f68271/0x998c12b283538581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.351964:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6f68271/0x998c12b283538581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.351972:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6f68271/0x998c12b283538581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.351983:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832360.352198:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832360.352250:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832360.352253:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832360.352256:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788832360.352486:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.352493:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b283538588 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.352502:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.352505:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.352510:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b283538588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.352519:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b283538588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.352539:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b283538588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.352545:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b283538588 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.352568:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788832360.352973:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832360.352979:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b283538588 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.352987:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030a00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:0.0:1788832360.352991:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b283538588 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.352999:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b283538588 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.353011:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b283538588 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.353044:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055beffee/0x998c12b283538588 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.353060:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832360.353063:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832360.353064:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788832360.353531:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788832360.353539:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089079910/0x998c12b28353858f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.353548:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788832360.353551:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832360.353556:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089079910/0x998c12b28353858f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.353567:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089079910/0x998c12b28353858f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.353576:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089079910/0x998c12b28353858f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.353596:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089079910/0x998c12b28353858f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.353608:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788832360.353993:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832360.354001:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089079910/0x998c12b28353858f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.354010:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01228800 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:0.0:1788832360.354014:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089079910/0x998c12b28353858f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.354836:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089079910/0x998c12b28353858f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.354858:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089079910/0x998c12b28353858f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.354865:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089079910/0x998c12b28353858f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.354884:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832360.354886:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832360.354888:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832360.354952:0:19721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832360.354954:0:19721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832360.354956:0:19721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788832360.357928:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788832360.357944:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000392a7ad3/0x998c12b283538596 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.357959:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788832360.357964:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832360.357970:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000392a7ad3/0x998c12b283538596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.357983:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000392a7ad3/0x998c12b283538596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.357994:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000392a7ad3/0x998c12b283538596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.358001:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000392a7ad3/0x998c12b283538596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.358022:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832360.358033:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.358039:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000392a7ad3/0x998c12b283538596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.358058:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01228000 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.358062:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000392a7ad3/0x998c12b283538596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.358071:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000392a7ad3/0x998c12b283538596 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.358087:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000392a7ad3/0x998c12b283538596 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.358094:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000392a7ad3/0x998c12b283538596 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.358109:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.358111:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.358113:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788832360.358755:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788832360.358762:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057001f27/0x998c12b28353859d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.358773:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788832360.358777:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832360.358782:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057001f27/0x998c12b28353859d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.358792:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057001f27/0x998c12b28353859d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.358808:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057001f27/0x998c12b28353859d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.358816:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057001f27/0x998c12b28353859d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.358833:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788832360.358862:0:19721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832360.358870:0:19721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057001f27/0x998c12b28353859d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.358879:0:19721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01229600 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:0.0:1788832360.358884:0:19721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057001f27/0x998c12b28353859d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.358893:0:19721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057001f27/0x998c12b28353859d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.358908:0:19721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057001f27/0x998c12b28353859d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.358917:0:19721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057001f27/0x998c12b28353859d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.358931:0:19721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832360.358934:0:19721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832360.358935:0:19721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832360.359194:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6f68271/0x998c12b283538581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.359204:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031600 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:3.0:1788832360.359207:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6f68271/0x998c12b283538581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.359217:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6f68271/0x998c12b283538581 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.359228:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6f68271/0x998c12b283538581 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.359236:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6f68271/0x998c12b283538581 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.359251:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832360.359253:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832360.359261:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788832360.363559:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788832360.363571:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6839f72/0x998c12b2835385a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.363587:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1788832360.363591:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832360.365556:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6839f72/0x998c12b2835385a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.365579:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6839f72/0x998c12b2835385a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.365591:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6839f72/0x998c12b2835385a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.365599:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6839f72/0x998c12b2835385a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832360.365707:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788832360.365802:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.365809:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6839f72/0x998c12b2835385a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.365819:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01228200 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.365823:0:17240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6839f72/0x998c12b2835385a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.365833:0:17240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6839f72/0x998c12b2835385a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.365852:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6839f72/0x998c12b2835385a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.365859:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6839f72/0x998c12b2835385a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.365882:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.365884:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.365886:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788832360.367104:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788832360.367115:0:19715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b2835385ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.367130:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=500s v=(0 0) 00010000:00010000:3.0:1788832360.367134:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832360.367140:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b2835385ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.367152:0:19715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b2835385ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.367162:0:19715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b2835385ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.367170:0:19715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b2835385ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832360.367199:0:19715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788832360.367250:0:19715:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1788832360.367333:0:19715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17278:x1875726218492928:12345-0@lo:5:osp-pre-1-0.0 Request processed in 144441us (145261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832360.367344:0:19715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788832360.367478:0:17278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17278:1875726218492928:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788832360.367496:0:17278:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1788832360.367538:0:17278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17278:1875726218493568:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788832360.367571:0:17278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832360.367609:0:17278:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0f900 going to sleep for 11 seconds 00010000:00010000:2.0:1788832360.367648:0:19721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788832360.367653:0:19721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b2835385ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.367661:0:19721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031000 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832360.367664:0:19721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b2835385ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.367683:0:19721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b2835385ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.367696:0:19721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b2835385ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.367703:0:19721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031a3ed66/0x998c12b2835385ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832360.367717:0:19721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.367719:0:19721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832360.367720:0:19721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832360.367833:0:19717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218493568 00000100:00100000:3.0:1788832360.367840:0:19717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218493568 00000100:00100000:3.0:1788832360.367882:0:19717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788832360.367891:0:19717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:17278:x1875726218493568:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788832360.367932:0:19717:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:3.0:1788832360.390255:0:19717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:17278:x1875726218493568:12345-0@lo:5:osp-pre-1-0.0 Request processed in 22358us (22675us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788832360.390267:0:19717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788832360.391878:0:17278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17278:1875726218493568:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788832360.391896:0:17278:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000040:00080000:2.0:1788832361.176879:0:18007:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788832361.366910:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832362.392042:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832363.414915:0:19721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788832364.251703:0:19932:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg326-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788832364.441170:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832364.762685:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218493696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832364.762764:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832364.762838:0:18761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218493696 00000100:00100000:2.0:1788832364.762846:0:18761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218493696 00000100:00100000:2.0:1788832364.762901:0:18761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788832364.762910:0:18761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218493696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788832364.762939:0:18761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788832364.762982:0:18761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218493696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832364.762989:0:18761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788832364.763009:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832364.763046:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218493696:0@lo:13:osp-pre-0-1.0 00000020:00000004:0.0:1788832365.122984:0:19984:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788832365.123257:0:19984:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788832365.271862:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218493952:0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.271929:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832365.271986:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218494464:0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.272010:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832365.272029:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1875726218494976:0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.272051:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832365.272072:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788832365.272078:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e119a26-e2c8-49b5-8e81-f568246f48a1:3652:1875726218493824:0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.272103:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832365.272123:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875726218494336:0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.272143:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832365.272157:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218494848:0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.272176:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832365.272193:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218495360:0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.272212:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832365.272238:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218494080:0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.272263:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832365.272277:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218494592:0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.272295:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832365.272311:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218495104:0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.272330:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832365.272343:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788832365.272348:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218494208:0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.272369:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832365.272383:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218494720:0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.272400:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832365.272434:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218495232:0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.272456:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832365.272483:0:18308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218493952 00000100:00100000:0.0:1788832365.272503:0:18308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218493952 00000100:00100000:0.0:1788832365.272542:0:18308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218494464 00000100:00100000:0.0:1788832365.272545:0:18308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218494464 00000100:00100000:0.0:1788832365.272561:0:18308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788832365.272570:0:18308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218493952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.272658:0:18308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1875726218493952:12345-0@lo:400:kworker.0 Request processed in 88us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832365.272666:0:18308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788832365.272683:0:18308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788832365.272689:0:18308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218494464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.272717:0:18308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218494464:12345-0@lo:400:kworker.0 Request processed in 28us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832365.272723:0:18308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788832365.272745:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218494976 00000100:00100000:0.0:1788832365.272748:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218494976 00000100:00100000:0.0:1788832365.272775:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218494336 00000100:00100000:0.0:1788832365.272778:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218494336 00000100:00100000:0.0:1788832365.272788:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218494848 00000100:00100000:0.0:1788832365.272790:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218494848 00000100:00100000:0.0:1788832365.272800:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218495360 00000100:00100000:0.0:1788832365.272802:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218495360 00000100:00100000:0.0:1788832365.272812:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218495104 00000100:00100000:0.0:1788832365.272815:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218495104 00000100:00100000:0.0:1788832365.272826:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218495232 00000100:00100000:0.0:1788832365.272828:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218495232 00000100:00100000:0.0:1788832365.272840:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788832365.272845:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875726218494976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.272881:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875726218494976:12345-0@lo:400:kworker.0 Request processed in 35us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832365.272887:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788832365.272900:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788832365.272906:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875726218494336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.272930:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875726218494336:12345-0@lo:400:kworker.0 Request processed in 24us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832365.272936:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788832365.272946:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788832365.272951:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218494848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.272973:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1875726218494848:12345-0@lo:400:kworker.0 Request processed in 22us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832365.272979:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788832365.272989:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788832365.272994:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875726218495360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.273016:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1875726218495360:12345-0@lo:400:kworker.0 Request processed in 21us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832365.273022:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788832365.273031:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788832365.273036:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218495104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.273063:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1875726218495104:12345-0@lo:400:kworker.0 Request processed in 26us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832365.273069:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788832365.273079:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788832365.273085:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218495232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.273117:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218495232:12345-0@lo:400:kworker.0 Request processed in 31us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832365.273124:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788832365.273141:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218493824 00000100:00100000:0.0:1788832365.273145:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218493824 00000100:00100000:0.0:1788832365.273167:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788832365.273173:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:3652:x1875726218493824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.273201:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:3652:x1875726218493824:12345-0@lo:400:kworker.0 Request processed in 29us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832365.273207:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788832365.273245:0:18758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218494080 00000100:00100000:0.0:1788832365.273248:0:18758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218494080 00000100:00100000:0.0:1788832365.273273:0:18758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218494592 00000100:00100000:0.0:1788832365.273276:0:18758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218494592 00000100:00100000:0.0:1788832365.273292:0:18758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218494208 00000100:00100000:0.0:1788832365.273294:0:18758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218494208 00000100:00100000:0.0:1788832365.273306:0:18758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218494720 00000100:00100000:0.0:1788832365.273309:0:18758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218494720 00000100:00100000:0.0:1788832365.273321:0:18758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788832365.273326:0:18758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218494080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.273356:0:18758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218494080:12345-0@lo:400:kworker.0 Request processed in 29us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832365.273361:0:18758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788832365.273372:0:18758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788832365.273378:0:18758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218494592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.273402:0:18758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218494592:12345-0@lo:400:kworker.0 Request processed in 25us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832365.273417:0:18758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788832365.273429:0:18758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788832365.273435:0:18758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1875726218494208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.273464:0:18758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1875726218494208:12345-0@lo:400:kworker.0 Request processed in 29us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832365.273468:0:18758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788832365.273479:0:18758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788832365.273483:0:18758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218494720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.273504:0:18758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06612d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218494720:12345-0@lo:400:kworker.0 Request processed in 21us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832365.273509:0:18758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788832365.273549:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218494208:0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.273559:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218494720:0@lo:400:kworker.0 00010000:00080000:0.0:1788832365.273571:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b06611f80 x1875726218495232/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832365.273580:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218495232:0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.273590:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218494080:0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.273597:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218494592:0@lo:400:kworker.0 00010000:00080000:0.0:1788832365.273606:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b06613480 x1875726218495104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832365.273613:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1875726218495104:0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.273700:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e119a26-e2c8-49b5-8e81-f568246f48a1:3652:1875726218493824:0@lo:400:kworker.0 00010000:00080000:0.0:1788832365.273722:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fc05880 x1875726218494336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832365.273730:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875726218494336:0@lo:400:kworker.0 00010000:00080000:0.0:1788832365.273740:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b06613800 x1875726218494848/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832365.273747:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1875726218494848:0@lo:400:kworker.0 00010000:00080000:0.0:1788832365.273756:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b06612680 x1875726218495360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832365.273763:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1875726218495360:0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.273773:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1875726218493952:0@lo:400:kworker.0 00000100:00100000:0.0:1788832365.273781:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218494464:0@lo:400:kworker.0 00010000:00080000:0.0:1788832365.273790:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b06612a00 x1875726218494976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832365.273797:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1875726218494976:0@lo:400:kworker.0 00000100:00080000:2.0:1788832365.274135:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788832365.274139:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788832365.274142:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788832365.274144:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832365.274600:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788832365.274614:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b0771ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218495488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832365.274697:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832365.274922:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218495616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788832365.274949:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832365.275071:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218495872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788832365.275109:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832365.275138:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218495744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788832365.275160:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832365.275188:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218495616 00000100:00100000:0.0:1788832365.275194:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218495616 00000100:00100000:0.0:1788832365.275225:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218495744 00000100:00100000:0.0:1788832365.275228:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218495744 00000100:00100000:0.0:1788832365.275251:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788832365.275258:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218495616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788832365.275287:0:17256:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788832365.275402:0:18761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218495488 00000100:00100000:2.0:1788832365.275406:0:18761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218495488 00000100:00100000:2.0:1788832365.275425:0:18761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218495872 00000100:00100000:2.0:1788832365.275428:0:18761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218495872 00000100:00100000:2.0:1788832365.275439:0:18761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788832365.275445:0:18761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875726218495488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788832365.275461:0:18761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788832365.277710:0:18761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1875726218495488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2257us (3005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832365.277722:0:18761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788832365.277755:0:18761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788832365.277768:0:18761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218495872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788832365.277804:0:18761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788832365.277855:0:18761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218495872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (2746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832365.277862:0:18761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788832365.277890:0:17257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788832365.277899:0:17257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218495744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788832365.277923:0:17257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788832365.277963:0:17257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218495744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (2802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832365.277969:0:17257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788832365.278017:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218495744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832365.278052:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218495872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832365.278068:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b0771ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218495488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832365.278086:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832365.278095:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218496000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788832365.278126:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832365.278150:0:18761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218496000 00000100:00100000:2.0:1788832365.278155:0:18761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218496000 00000100:00100000:2.0:1788832365.278183:0:18761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788832365.278189:0:18761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218496000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788832365.278199:0:18761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788832365.278230:0:18761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218496000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832365.278236:0:18761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788832365.278273:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218496000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788832365.281806:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218495616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6538us (6845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832365.281822:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788832365.285393:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218495616:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788832365.462898:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788832365.791329:0:19571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000020:00000004:2.0:1788832365.986113:0:20034:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788832365.986533:0:20034:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788832366.216783:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832366.217477:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202686464 00000100:00100000:0.0:1788832366.217488:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202686464 00000100:00100000:0.0:1788832366.217538:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 115 00000100:00100000:0.0:1788832366.217547:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2392:x1875726202686464:12345-192.168.203.26@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788832366.217573:0:17245:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0@192.168.203.26@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:0.0:1788832366.217670:0:17245:0:(genops.c:1385:class_connect()) connect: client c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0, cookie 0x998c12b2835385b2 00000100:00080000:0.0:1788832366.217810:0:17245:0:(import.c:65:import_set_state_nolock()) ffff9d2c04cdd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788832366.217873:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+5:2392:x1875726202686464:12345-192.168.203.26@tcp:250:mount.lustre.0 Request processed in 326us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832366.217881:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 115 00000100:00100000:3.0:1788832366.221241:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832366.221338:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202686592 00000100:00100000:2.0:1788832366.221349:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202686592 00000100:00100000:2.0:1788832366.221418:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 116 00000100:00100000:2.0:1788832366.221429:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+5:14915:x1875726202686592:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788832366.221445:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832366.221462:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c01228e00/0x998c12b2835385b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04a1c expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832366.221489:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c01228e00/0x998c12b2835385b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a1c expref: 6 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832366.221500:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c01228e00/0x998c12b2835385b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a1c expref: 6 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832366.221509:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c01228e00, rc 0) 00000100:00100000:2.0:1788832366.221563:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+6:14915:x1875726202686592:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 137us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832366.221571:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 116 00000100:00100000:3.0:1788832366.235169:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832366.235356:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202686720 00000100:00100000:0.0:1788832366.235370:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202686720 00000100:00100000:0.0:1788832366.235446:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 117 00000100:00100000:0.0:1788832366.235459:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+6:14915:x1875726202686720:12345-192.168.203.26@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788832366.235721:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+6:14915:x1875726202686720:12345-192.168.203.26@tcp:501:mount.lustre.0 Request processed in 265us (568us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788832366.235730:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 117 00000100:00100000:3.0:1788832366.238969:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832366.239029:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202686848 00000100:00100000:0.0:1788832366.239046:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202686848 00000100:00100000:0.0:1788832366.239129:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 118 00000100:00100000:0.0:1788832366.239160:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+6:14915:x1875726202686848:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788832366.239184:0:17244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832366.239210:0:17244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c1fe0de00/0x998c12b2835385c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04a23 expref: -99 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832366.239247:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c1fe0de00/0x998c12b2835385c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a23 expref: 7 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832366.239261:0:17244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c1fe0de00/0x998c12b2835385c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a23 expref: 7 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832366.239271:0:17244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0de00, rc 0) 00000100:00100000:0.0:1788832366.239357:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+7:14915:x1875726202686848:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 199us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832366.239365:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 118 00000100:00100000:0.0:1788832366.244517:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832366.244592:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202686976 00000100:00100000:2.0:1788832366.244602:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202686976 00000100:00100000:2.0:1788832366.246415:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 119 00000100:00100000:2.0:1788832366.246437:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+7:14915:x1875726202686976:12345-192.168.203.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788832366.246655:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+8:14915:x1875726202686976:12345-192.168.203.26@tcp:501:mount.lustre.0 Request processed in 226us (2244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832366.248591:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832366.248685:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202687104 00000100:00100000:1.0:1788832366.248694:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202687104 00000100:00100000:1.0:1788832366.248747:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 120 00000100:00100000:1.0:1788832366.248756:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+9:14915:x1875726202687104:12345-192.168.203.26@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788832366.248808:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 119 00000100:00100000:1.0:1788832366.248876:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+8:14915:x1875726202687104:12345-192.168.203.26@tcp:503:mount.lustre.0 Request processed in 120us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832366.248887:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 120 00000100:00100000:0.0:1788832366.250851:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832366.251065:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202687232 00000100:00100000:2.0:1788832366.251075:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202687232 00000100:00100000:2.0:1788832366.251184:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 121 00000100:00100000:2.0:1788832366.251195:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+8:14934:x1875726202687232:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788832366.251516:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+8:14934:x1875726202687232:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 321us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832366.251523:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 121 00000100:00100000:0.0:1788832366.289478:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832366.289574:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202687360 00000100:00100000:3.0:1788832366.289585:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202687360 00000100:00100000:3.0:1788832366.289675:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 122 00000100:00100000:3.0:1788832366.289686:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+8:14934:x1875726202687360:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788832366.289831:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+8:14934:x1875726202687360:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 147us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832366.289839:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 122 00000100:00100000:0.0:1788832366.292808:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832366.299228:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202687488 00000100:00100000:2.0:1788832366.299242:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202687488 00000100:00100000:2.0:1788832366.299302:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 123 00000100:00100000:2.0:1788832366.299311:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+8:14934:x1875726202687488:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788832366.299561:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+8:14934:x1875726202687488:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 249us (6759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832366.299571:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 123 00000100:00100000:0.0:1788832366.304845:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832366.305036:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202687616 00000100:00100000:1.0:1788832366.305050:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202687616 00000100:00100000:1.0:1788832366.305120:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 124 00000100:00100000:1.0:1788832366.305133:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+8:14915:x1875726202687616:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788832366.305156:0:17244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832366.305181:0:17244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c3050ac00/0x998c12b2835385c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04a54 expref: -99 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832366.305209:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c3050ac00/0x998c12b2835385c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a54 expref: 9 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832366.305220:0:17244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c3050ac00/0x998c12b2835385c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a54 expref: 9 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832366.305247:0:17244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c3050ac00, rc 0) 00000100:00100000:1.0:1788832366.306749:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+9:14915:x1875726202687616:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 1611us (1902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832366.306761:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 124 00000100:00100000:3.0:1788832366.310107:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832366.310366:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202687744 00000100:00100000:1.0:1788832366.310378:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202687744 00000100:00100000:1.0:1788832366.310437:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 125 00000100:00100000:1.0:1788832366.310447:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3eb3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+9:14915:x1875726202687744:12345-192.168.203.26@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788832366.310471:0:17245:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788832366.310493:0:17245:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788832366.310497:0:17245:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788832366.310500:0:17245:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788832366.310503:0:17245:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788832366.310505:0:17245:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1788832366.312828:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3eb3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+9:14915:x1875726202687744:12345-192.168.203.26@tcp:256:mount.lustre.0 Request processed in 2375us (2722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832366.312840:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 125 00000100:00100000:0.0:1788832366.316811:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832366.317263:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202687872 00000100:00100000:1.0:1788832366.317273:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202687872 00000100:00100000:1.0:1788832366.317329:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 126 00000100:00100000:1.0:1788832366.317340:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e9e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+9:14915:x1875726202687872:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788832366.317366:0:17244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832366.317385:0:17244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c3050b000/0x998c12b2835385ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04a5b expref: -99 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832366.317414:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c3050b000/0x998c12b2835385ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a5b expref: 10 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832366.317439:0:17244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c3050b000/0x998c12b2835385ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a5b expref: 10 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832366.317455:0:17244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c3050b000, rc 0) 00000100:00100000:1.0:1788832366.317515:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e9e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+10:14915:x1875726202687872:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 176us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832366.317522:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 126 00000100:00100000:3.0:1788832366.319784:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832366.320188:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202688000 00000100:00100000:1.0:1788832366.320198:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202688000 00000100:00100000:1.0:1788832366.320259:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 127 00000100:00100000:1.0:1788832366.320268:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3e9e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+10:14915:x1875726202688000:12345-192.168.203.26@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788832366.321314:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3e9e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+10:14915:x1875726202688000:12345-192.168.203.26@tcp:501:mount.lustre.0 Request processed in 1042us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832366.321326:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 127 00000100:00100000:0.0:1788832366.327056:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832366.327194:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202688128 00000100:00100000:3.0:1788832366.327204:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202688128 00000100:00100000:3.0:1788832366.327276:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 128 00000100:00100000:3.0:1788832366.327286:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+10:14915:x1875726202688128:12345-192.168.203.26@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788832366.328092:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+10:14915:x1875726202688128:12345-192.168.203.26@tcp:503:mount.lustre.0 Request processed in 804us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832366.328102:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 128 00000100:00100000:0.0:1788832366.332551:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832366.332667:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202688256 00000100:00100000:1.0:1788832366.332676:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202688256 00000100:00100000:1.0:1788832366.332910:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 129 00000100:00100000:1.0:1788832366.332920:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+10:14938:x1875726202688256:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788832366.333088:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+10:14938:x1875726202688256:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 167us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832366.333097:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 129 00000100:00100000:0.0:1788832366.335330:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832366.335510:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202688384 00000100:00100000:2.0:1788832366.335519:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202688384 00000100:00100000:2.0:1788832366.335583:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 130 00000100:00100000:2.0:1788832366.335593:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+10:14938:x1875726202688384:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788832366.336788:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+10:14938:x1875726202688384:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 1191us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832366.336798:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 130 00000100:00100000:3.0:1788832366.345010:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832366.345734:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202688512 00000100:00100000:0.0:1788832366.345747:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202688512 00000100:00100000:0.0:1788832366.345837:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:0.0:1788832366.345860:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2392:x1875726202688512:12345-192.168.203.26@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788832366.345892:0:17253:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be@192.168.203.26@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:0.0:1788832366.345948:0:17253:0:(genops.c:1385:class_connect()) connect: client 73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be, cookie 0x998c12b2835385d5 00000004:00100000:0.0:1788832366.345976:0:17253:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788832366.346192:0:17253:0:(import.c:65:import_set_state_nolock()) ffff9d2c2f59b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788832366.346290:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:2392:x1875726202688512:12345-192.168.203.26@tcp:38:mount.lustre.0 Request processed in 430us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832366.346297:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:0.0:1788832366.352662:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832366.353108:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202688768 00000100:00100000:3.0:1788832366.353119:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202688768 00000100:00100000:3.0:1788832366.353168:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:3.0:1788832366.353190:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1875726202688768:12345-192.168.203.26@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788832366.353348:0:17816:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be@192.168.203.26@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:3.0:1788832366.353397:0:17816:0:(genops.c:1385:class_connect()) connect: client 73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be, cookie 0x998c12b2835385dc 00000004:00100000:3.0:1788832366.353422:0:17816:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788832366.354876:0:17816:0:(import.c:65:import_set_state_nolock()) ffff9d2b010ff000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832366.362188:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:2392:x1875726202688768:12345-192.168.203.26@tcp:38:mount.lustre.0 Request processed in 8982us (9548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832366.362203:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:1.0:1788832366.365573:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832366.365609:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832366.365780:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202689024 00000100:00100000:0.0:1788832366.365790:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202689024 00000100:00100000:0.0:1788832366.365898:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202688640 00000100:00100000:0.0:1788832366.365901:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202688640 00000100:00100000:0.0:1788832366.365927:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:0.0:1788832366.365937:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+7:14915:x1875726202689024:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788832366.365972:0:17253:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788832366.366067:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+7:14915:x1875726202689024:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 131us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832366.366075:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:0.0:1788832366.366094:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:0.0:1788832366.366101:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:0:x1875726202688640:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788832366.366112:0:17253:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788832366.366135:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:0:x1875726202688640:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 34us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832366.366141:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00080000:2.0:1788832366.366732:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832366.372497:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832366.372560:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832366.382479:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202689152 00000100:00100000:2.0:1788832366.382498:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202689152 00000100:00100000:1.0:1788832366.382693:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202688896 00000100:00100000:1.0:1788832366.382698:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202688896 00000100:00100000:1.0:1788832366.382736:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:1.0:1788832366.382747:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:14915:x1875726202689152:12345-192.168.203.26@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788832366.382838:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:14915:x1875726202689152:12345-192.168.203.26@tcp:40:mount.lustre.0 Request processed in 93us (10351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832366.382846:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:1.0:1788832366.382865:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:1.0:1788832366.382871:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:0:x1875726202688896:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788832366.382895:0:17251:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788832366.382943:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:0:x1875726202688896:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 73us (10383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832366.382950:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00080000:2.0:1788832366.383507:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788832366.389923:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832366.390034:0:18758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202689280 00000100:00100000:0.0:1788832366.390043:0:18758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202689280 00000100:00100000:0.0:1788832366.390095:0:18758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:0.0:1788832366.390104:0:18758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1875726202689280:12345-192.168.203.26@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788832366.390140:0:18758:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be@192.168.203.26@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:0.0:1788832366.390174:0:18758:0:(genops.c:1385:class_connect()) connect: client 73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be, cookie 0x998c12b2835385e3 00002000:00100000:0.0:1788832366.390187:0:18758:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be/ffff9d2c2f59a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788832366.390207:0:18758:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788832366.390508:0:18758:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788832366.390538:0:18758:0:(import.c:65:import_set_state_nolock()) ffff9d2c2f598800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788832366.390607:0:18758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:2392:x1875726202689280:12345-192.168.203.26@tcp:8:mount.lustre.0 Request processed in 503us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832366.390615:0:18758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:1.0:1788832366.392696:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832366.392799:0:18759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202689408 00000100:00100000:2.0:1788832366.392809:0:18759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202689408 00000100:00100000:2.0:1788832366.392857:0:18759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:2.0:1788832366.392867:0:18759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0771ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2392:x1875726202689408:12345-192.168.203.26@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788832366.392902:0:18759:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be@192.168.203.26@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:2.0:1788832366.392933:0:18759:0:(genops.c:1385:class_connect()) connect: client 73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be, cookie 0x998c12b2835385ea 00002000:00100000:2.0:1788832366.392946:0:18759:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be/ffff9d2b01976800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788832366.392959:0:18759:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788832366.393157:0:18759:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788832366.393187:0:18759:0:(import.c:65:import_set_state_nolock()) ffff9d2b01972800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832366.393412:0:18759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0771ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:2392:x1875726202689408:12345-192.168.203.26@tcp:8:mount.lustre.0 Request processed in 544us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832366.393420:0:18759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:1.0:1788832366.397467:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832366.397885:0:17262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202689536 00000100:00100000:3.0:1788832366.397895:0:17262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202689536 00000100:00100000:3.0:1788832366.397997:0:17262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:3.0:1788832366.398008:0:17262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:14915:x1875726202689536:12345-192.168.203.26@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788832366.398081:0:17262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:14915:x1875726202689536:12345-192.168.203.26@tcp:900:mount.lustre.0 Request processed in 75us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832366.398089:0:17262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:1.0:1788832366.404786:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832366.404912:0:17254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202689664 00000100:00100000:0.0:1788832366.404922:0:17254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202689664 00000100:00100000:0.0:1788832366.404977:0:17254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:0.0:1788832366.404988:0:17254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:14915:x1875726202689664:12345-192.168.203.26@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788832366.409108:0:17254:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4022us 00000004:00200000:1.0:1788832366.431706:0:17254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788832366.431839:0:17254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:14915:x1875726202689664:12345-192.168.203.26@tcp:33:mount.lustre.0 Request processed in 26846us (27059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832366.431853:0:17254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 0 00010000:00010000:2.0:1788832366.486967:0:19721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832366.591495:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832366.592183:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202689792 00000100:00100000:1.0:1788832366.592204:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202689792 00000100:00100000:1.0:1788832366.592273:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:1.0:1788832366.592284:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:14961:x1875726202689792:12345-192.168.203.26@tcp:101:mkdir.0 00010000:00010000:1.0:1788832366.592318:0:17251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832366.592345:0:17251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050b800/0x998c12b2835385f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04a8c expref: -99 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832366.592409:0:17251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050bc00/0x998c12b2835385f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832366.592431:0:17251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050bc00/0x998c12b2835385f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832366.592447:0:17251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050bc00/0x998c12b2835385f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832366.592492:0:17251:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788832366.592496:0:17251:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788832366.592532:0:17251:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050bc00/0x998c12b2835385f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832366.592571:0:17251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050b800/0x998c12b2835385f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a8c expref: 8 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832366.592592:0:17251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050bc00/0x998c12b2835385f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a8c expref: 7 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832366.592602:0:17251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2b073aec00) 00010000:00010000:1.0:1788832366.592605:0:17251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788832366.592608:0:17251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c3050bc00, rc 0) 00000100:00100000:1.0:1788832366.592734:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+7:14961:x1875726202689792:12345-192.168.203.26@tcp:101:mkdir.0 Request processed in 451us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832366.592742:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 13 00010000:00010000:2.0:1788832367.511452:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788832368.023499:0:17287:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788832368.503206:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832368.503427:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202689920 00000100:00100000:0.0:1788832368.503443:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202689920 00000100:00100000:0.0:1788832368.503545:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:0.0:1788832368.503557:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+7:15013:x1875726202689920:12345-192.168.203.26@tcp:41:lfs.0 00000004:00000024:0.0:1788832368.503596:0:17252:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788832368.503764:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+7:15013:x1875726202689920:12345-192.168.203.26@tcp:41:lfs.0 Request processed in 209us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832368.503787:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00080000:2.0:1788832368.503946:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832368.505450:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832368.505696:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202690048 00000100:00100000:0.0:1788832368.505706:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202690048 00000100:00100000:0.0:1788832368.505783:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:0.0:1788832368.505793:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:15013:x1875726202690048:12345-192.168.203.26@tcp:41:lfs.0 00000004:00000024:0.0:1788832368.505830:0:17253:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788832368.505922:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:15013:x1875726202690048:12345-192.168.203.26@tcp:41:lfs.0 Request processed in 130us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832368.505930:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00080000:2.0:1788832368.506444:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788832368.510542:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832368.510709:0:18761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202690176 00000100:00100000:2.0:1788832368.510719:0:18761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202690176 00000100:00100000:2.0:1788832368.510802:0:18761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:2.0:1788832368.510814:0:18761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:15013:x1875726202690176:12345-192.168.203.26@tcp:13:lfs.0 00002000:00000024:2.0:1788832368.510847:0:18761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788832368.510935:0:18761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:15013:x1875726202690176:12345-192.168.203.26@tcp:13:lfs.0 Request processed in 123us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832368.510943:0:18761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00080000:0.0:1788832368.511023:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788832368.516328:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832368.518273:0:18761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202690304 00000100:00100000:0.0:1788832368.518284:0:18761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202690304 00000100:00100000:0.0:1788832368.518388:0:18761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:0.0:1788832368.518400:0:18761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:15013:x1875726202690304:12345-192.168.203.26@tcp:13:lfs.0 00002000:00000024:0.0:1788832368.518442:0:18761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788832368.518790:0:18761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:15013:x1875726202690304:12345-192.168.203.26@tcp:13:lfs.0 Request processed in 391us (3842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832368.518798:0:18761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00080000:1.0:1788832368.518942:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788832368.536392:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832368.749682:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832368.749786:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202690432 00000100:00100000:0.0:1788832368.749796:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202690432 00000100:00100000:0.0:1788832368.749856:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 131 00000100:00100000:0.0:1788832368.749868:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04ddb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+10:15044:x1875726202690432:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788832368.749886:0:17244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832368.749903:0:17244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c1fe0da00/0x998c12b2835385ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04a93 expref: -99 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832368.749952:0:17244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c1fe0da00/0x998c12b2835385ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a93 expref: 11 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832368.749964:0:17244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c1fe0da00/0x998c12b2835385ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a93 expref: 11 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832368.749973:0:17244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0da00, rc 0) 00000100:00100000:0.0:1788832368.750323:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04ddb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+11:15044:x1875726202690432:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 457us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832368.750331:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 131 00000100:00100000:1.0:1788832368.759714:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832368.759822:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202690560 00000100:00100000:2.0:1788832368.759832:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202690560 00000100:00100000:2.0:1788832368.759889:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 132 00000100:00100000:2.0:1788832368.759899:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+11:15044:x1875726202690560:12345-192.168.203.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788832368.760051:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+11:15044:x1875726202690560:12345-192.168.203.26@tcp:501:mount.lustre.0 Request processed in 153us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832368.760059:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 132 00000100:00100000:3.0:1788832368.764399:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832368.764534:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202690688 00000100:00100000:0.0:1788832368.764543:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202690688 00000100:00100000:0.0:1788832368.764610:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 133 00000100:00100000:0.0:1788832368.764665:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04ddbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+11:15044:x1875726202690688:12345-192.168.203.26@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788832368.764979:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04ddbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+11:15044:x1875726202690688:12345-192.168.203.26@tcp:503:mount.lustre.0 Request processed in 316us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832368.764988:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 133 00000100:00100000:3.0:1788832368.783112:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832368.786276:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202690816 00000100:00100000:1.0:1788832368.786290:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202690816 00000100:00100000:1.0:1788832368.786371:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 134 00000100:00100000:1.0:1788832368.786381:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04ddb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+11:15051:x1875726202690816:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788832368.786549:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04ddb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+11:15051:x1875726202690816:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 169us (3447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832368.786558:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 134 00000100:00100000:1.0:1788832368.842056:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832368.845504:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202690944 00000100:00100000:2.0:1788832368.845520:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202690944 00000100:00100000:2.0:1788832368.845595:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 135 00000100:00100000:2.0:1788832368.845608:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04ddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+11:15051:x1875726202690944:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788832368.845829:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04ddac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+11:15051:x1875726202690944:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 222us (3780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832368.845837:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 135 00000100:00100000:3.0:1788832368.855842:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832368.856340:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202691072 00000100:00100000:0.0:1788832368.856351:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202691072 00000100:00100000:0.0:1788832368.856411:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 136 00000100:00100000:0.0:1788832368.856422:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+11:15051:x1875726202691072:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788832368.856596:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+11:15051:x1875726202691072:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 176us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832368.856604:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 136 00000100:00100000:3.0:1788832368.866845:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832368.868480:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202691200 00000100:00100000:1.0:1788832368.868496:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202691200 00000100:00100000:1.0:1788832368.868579:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 137 00000100:00100000:1.0:1788832368.868590:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+11:15044:x1875726202691200:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788832368.868609:0:17245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832368.868682:0:17245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c3050a400/0x998c12b283538606 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04ac4 expref: -99 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832368.868710:0:17245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c3050a400/0x998c12b283538606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04ac4 expref: 12 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832368.868721:0:17245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c3050a400/0x998c12b283538606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04ac4 expref: 12 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832368.868730:0:17245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c3050a400, rc 0) 00000100:00100000:1.0:1788832368.869068:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+12:15044:x1875726202691200:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 478us (2234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832368.869076:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 137 00000100:00100000:1.0:1788832368.878184:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832368.878333:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202691328 00000100:00100000:2.0:1788832368.878344:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202691328 00000100:00100000:2.0:1788832368.878418:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 138 00000100:00100000:2.0:1788832368.878429:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+12:15044:x1875726202691328:12345-192.168.203.26@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788832368.878456:0:17243:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788832368.878472:0:17243:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788832368.878477:0:17243:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788832368.878480:0:17243:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788832368.878483:0:17243:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788832368.878486:0:17243:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788832368.885502:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+12:15044:x1875726202691328:12345-192.168.203.26@tcp:256:mount.lustre.0 Request processed in 7062us (7313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832368.885517:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 138 00000100:00100000:3.0:1788832368.888724:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832368.888807:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202691456 00000100:00100000:1.0:1788832368.888817:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202691456 00000100:00100000:1.0:1788832368.888877:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 139 00000100:00100000:1.0:1788832368.888887:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+12:15044:x1875726202691456:12345-192.168.203.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788832368.888906:0:17245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832368.888926:0:17245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c3050ae00/0x998c12b28353860d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04acb expref: -99 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832368.888953:0:17245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c3050ae00/0x998c12b28353860d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04acb expref: 13 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832368.888964:0:17245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c3050ae00/0x998c12b28353860d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04acb expref: 13 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832368.888973:0:17245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c3050ae00, rc 0) 00000100:00100000:1.0:1788832368.889067:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:15044:x1875726202691456:12345-192.168.203.26@tcp:101:mount.lustre.0 Request processed in 181us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832368.889074:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 139 00000100:00100000:1.0:1788832368.892834:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832368.893318:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202691584 00000100:00100000:2.0:1788832368.893336:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202691584 00000100:00100000:2.0:1788832368.893394:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 140 00000100:00100000:2.0:1788832368.893403:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:15044:x1875726202691584:12345-192.168.203.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788832368.893754:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:15044:x1875726202691584:12345-192.168.203.26@tcp:501:mount.lustre.0 Request processed in 351us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832368.893761:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 140 00000100:00100000:3.0:1788832368.895654:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832368.895726:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202691712 00000100:00100000:2.0:1788832368.895735:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202691712 00000100:00100000:2.0:1788832368.895790:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 141 00000100:00100000:2.0:1788832368.895799:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:15044:x1875726202691712:12345-192.168.203.26@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788832368.897038:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:15044:x1875726202691712:12345-192.168.203.26@tcp:503:mount.lustre.0 Request processed in 1233us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832368.897049:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 141 00000100:00100000:3.0:1788832368.900108:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832368.900444:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202691840 00000100:00100000:2.0:1788832368.900477:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202691840 00000100:00100000:2.0:1788832368.900546:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 142 00000100:00100000:2.0:1788832368.900557:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:15057:x1875726202691840:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788832368.900748:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:15057:x1875726202691840:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 192us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832368.900755:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 142 00000100:00100000:1.0:1788832368.916301:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832368.916740:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202691968 00000100:00100000:2.0:1788832368.916750:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202691968 00000100:00100000:2.0:1788832368.916848:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 143 00000100:00100000:2.0:1788832368.916859:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:15057:x1875726202691968:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788832368.917018:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:15057:x1875726202691968:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 160us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832368.917027:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 143 00000100:00100000:1.0:1788832368.927503:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832368.927544:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832368.927580:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832368.927610:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832368.927701:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832368.927719:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832368.927740:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832368.927769:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202692992 00000100:00100000:1.0:1788832368.927779:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202692992 00000100:00100000:2.0:1788832368.927814:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202692864 00000100:00100000:2.0:1788832368.927818:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202692864 00000100:00100000:1.0:1788832368.927820:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202692096 00000100:00100000:1.0:1788832368.927822:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202692096 00000100:00100000:1.0:1788832368.927831:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202692352 00000100:00100000:1.0:1788832368.927833:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202692352 00000100:00100000:2.0:1788832368.927840:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:2.0:1788832368.927848:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:2396:x1875726202692992:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832368.927925:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:2396:x1875726202692992:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 77us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832368.928172:0:18760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202693248 00000100:00100000:3.0:1788832368.928177:0:18760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202693248 00000100:00100000:3.0:1788832368.928218:0:18760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202693120 00000100:00100000:3.0:1788832368.928221:0:18760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202693120 00000100:00100000:3.0:1788832368.928244:0:18760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:3.0:1788832368.928251:0:18760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:2396:x1875726202693248:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832368.928287:0:18760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:2396:x1875726202693248:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 33us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832368.928300:0:18760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:3.0:1788832368.928320:0:18760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:3.0:1788832368.928329:0:18760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:2396:x1875726202693120:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832368.928355:0:18760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:2396:x1875726202693120:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 29us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832368.928361:0:18760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:1.0:1788832368.928413:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:1.0:1788832368.928421:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+7:2396:x1875726202692864:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832368.928449:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+7:2396:x1875726202692864:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 30us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832368.928456:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:1.0:1788832368.928470:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:1.0:1788832368.928474:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875726202692096:12345-192.168.203.26@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788832368.928496:0:17251:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6@192.168.203.26@tcp t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:1.0:1788832368.928529:0:17251:0:(genops.c:1385:class_connect()) connect: client 25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6, cookie 0x998c12b283538614 00000004:00100000:1.0:1788832368.928568:0:17251:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788832368.928681:0:17251:0:(import.c:65:import_set_state_nolock()) ffff9d2b01a1a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788832368.928712:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:2392:x1875726202692096:12345-192.168.203.26@tcp:38:mount.lustre.0 Request processed in 234us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832368.928718:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:1.0:1788832368.928732:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:1.0:1788832368.928736:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875726202692352:12345-192.168.203.26@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788832368.928751:0:17251:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6@192.168.203.26@tcp t0 exp 0000000000000000 cur 508 last 0 00000100:00100000:2.0:1788832368.928776:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 41 00000020:00000080:1.0:1788832368.928777:0:17251:0:(genops.c:1385:class_connect()) connect: client 25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6, cookie 0x998c12b28353861b 00000004:00100000:1.0:1788832368.928789:0:17251:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788832368.928875:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202692736 00000100:00100000:0.0:1788832368.928886:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202692736 00000100:00100000:0.0:1788832368.928920:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 144 00000100:00100000:0.0:1788832368.928927:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:2396:x1875726202692736:12345-192.168.203.26@tcp:400:kworker.0 00000100:00080000:1.0:1788832368.928973:0:17251:0:(import.c:65:import_set_state_nolock()) ffff9d2b01a18000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788832368.928998:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:2392:x1875726202692352:12345-192.168.203.26@tcp:38:mount.lustre.0 Request processed in 260us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832368.929004:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:0.0:1788832368.934009:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:2396:x1875726202692736:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 5071us (6505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832368.934023:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 144 00000100:00100000:1.0:1788832368.940168:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832368.940247:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202692224 00000100:00100000:2.0:1788832368.940258:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202692224 00000100:00100000:2.0:1788832368.940384:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:2.0:1788832368.940394:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:0:x1875726202692224:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788832368.940425:0:17252:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788832368.940520:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:0:x1875726202692224:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 127us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832368.940528:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00080000:1.0:1788832368.941058:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832368.944589:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832368.944679:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832368.944751:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202692608 00000100:00100000:3.0:1788832368.944760:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202692608 00000100:00100000:3.0:1788832368.944801:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202692480 00000100:00100000:3.0:1788832368.944803:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202692480 00000100:00100000:3.0:1788832368.944842:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:3.0:1788832368.944851:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:15044:x1875726202692608:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788832368.944877:0:17816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788832368.944939:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:15044:x1875726202692608:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 88us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832368.944946:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:3.0:1788832368.944964:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:3.0:1788832368.944971:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:0:x1875726202692480:12345-192.168.203.26@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788832368.944987:0:17816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788832368.945015:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:0:x1875726202692480:12345-192.168.203.26@tcp:41:mount.lustre.0 Request processed in 44us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832368.945021:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00080000:1.0:1788832368.945078:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788832368.950414:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832368.950787:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202693376 00000100:00100000:0.0:1788832368.950796:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202693376 00000100:00100000:0.0:1788832368.950856:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:0.0:1788832368.950866:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:15044:x1875726202693376:12345-192.168.203.26@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788832368.950952:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:15044:x1875726202693376:12345-192.168.203.26@tcp:40:mount.lustre.0 Request processed in 87us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832368.951008:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:1.0:1788832368.958286:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832368.958329:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832368.958385:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832368.958666:0:19714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202693504 00000100:00100000:2.0:1788832368.958758:0:19714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202693504 00000100:00100000:2.0:1788832368.958792:0:19714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202693632 00000100:00100000:2.0:1788832368.958795:0:19714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202693632 00000100:00100000:2.0:1788832368.958811:0:19714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:2.0:1788832368.958819:0:19714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1875726202693504:12345-192.168.203.26@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788832368.958855:0:19714:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6@192.168.203.26@tcp t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:2.0:1788832368.958886:0:19714:0:(genops.c:1385:class_connect()) connect: client 25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6, cookie 0x998c12b283538622 00002000:00100000:2.0:1788832368.958898:0:19714:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6/ffff9d2b01972000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788832368.958910:0:19714:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788832368.958987:0:19714:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788832368.959014:0:19714:0:(import.c:65:import_set_state_nolock()) ffff9d2b01973800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832368.959071:0:19714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:2392:x1875726202693504:12345-192.168.203.26@tcp:8:mount.lustre.0 Request processed in 251us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832368.959078:0:19714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:2.0:1788832368.959094:0:19714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:2.0:1788832368.959099:0:19714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1875726202693632:12345-192.168.203.26@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788832368.959114:0:19714:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6@192.168.203.26@tcp t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:2.0:1788832368.959131:0:19714:0:(genops.c:1385:class_connect()) connect: client 25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6, cookie 0x998c12b283538629 00002000:00100000:2.0:1788832368.959136:0:19714:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6/ffff9d2b01970800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788832368.959141:0:19714:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788832368.959385:0:19714:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788832368.959402:0:19714:0:(import.c:65:import_set_state_nolock()) ffff9d2b01975000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788832368.959449:0:19714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:2392:x1875726202693632:12345-192.168.203.26@tcp:8:mount.lustre.0 Request processed in 348us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832368.959456:0:19714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:0.0:1788832368.961724:0:17263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202693760 00000100:00100000:0.0:1788832368.961740:0:17263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202693760 00000100:00100000:0.0:1788832368.961830:0:17263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:0.0:1788832368.961842:0:17263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:15044:x1875726202693760:12345-192.168.203.26@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788832368.961927:0:17263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:15044:x1875726202693760:12345-192.168.203.26@tcp:900:mount.lustre.0 Request processed in 87us (3651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832368.961935:0:17263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:1.0:1788832368.964732:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832368.964963:0:17255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202693888 00000100:00100000:2.0:1788832368.964972:0:17255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202693888 00000100:00100000:2.0:1788832368.965027:0:17255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:2.0:1788832368.965036:0:17255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:15044:x1875726202693888:12345-192.168.203.26@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788832368.965119:0:17255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788832368.965200:0:17255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:15044:x1875726202693888:12345-192.168.203.26@tcp:33:mount.lustre.0 Request processed in 165us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832368.965208:0:17255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:3.0:1788832369.165417:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832369.165690:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202694016 00000100:00100000:0.0:1788832369.165700:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202694016 00000100:00100000:0.0:1788832369.165769:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:0.0:1788832369.165779:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b08550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:15080:x1875726202694016:12345-192.168.203.26@tcp:101:mkdir.0 00010000:00010000:0.0:1788832369.165799:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832369.165827:0:17253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283538630 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04afc expref: -99 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832369.165890:0:17253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283538637 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832369.165904:0:17253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283538637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832369.165917:0:17253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283538637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832369.165957:0:17253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788832369.165961:0:17253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788832369.165982:0:17253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283538637 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832369.166008:0:17253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0cc00/0x998c12b283538630 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04afc expref: 8 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832369.166026:0:17253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283538637 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04afc expref: 7 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832369.166034:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2b073aec00) 00010000:00010000:0.0:1788832369.166037:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788832369.166040:0:17253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c1fe0d200, rc 0) 00000100:00100000:0.0:1788832369.166091:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b08550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+7:15080:x1875726202694016:12345-192.168.203.26@tcp:101:mkdir.0 Request processed in 313us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832369.166098:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 22 00010000:00010000:2.0:1788832369.559864:0:19721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788832369.884218:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788832369.884255:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218496128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788832369.884322:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832369.884402:0:18761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218496128 00000100:00100000:3.0:1788832369.884410:0:18761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218496128 00000100:00080000:0.0:1788832369.884458:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788832369.884479:0:18761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788832369.884490:0:18761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218496128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788832369.884512:0:18761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788832369.884572:0:18761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218496128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832369.884578:0:18761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788832369.884684:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218496128:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832370.394097:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218496384:0@lo:400:kworker.0 00000100:00100000:2.0:1788832370.394165:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832370.394231:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218496896:0@lo:400:kworker.0 00000100:00100000:2.0:1788832370.394255:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832370.394271:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218497408:0@lo:400:kworker.0 00000100:00100000:2.0:1788832370.394293:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832370.394326:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788832370.394334:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218496512:0@lo:400:kworker.0 00000100:00100000:2.0:1788832370.394359:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832370.394378:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218497024:0@lo:400:kworker.0 00000100:00100000:2.0:1788832370.394398:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832370.394413:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218497536:0@lo:400:kworker.0 00000100:00100000:2.0:1788832370.394444:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832370.394473:0:17257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218496384 00000100:00100000:2.0:1788832370.394480:0:17257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218496384 00000100:00100000:2.0:1788832370.394517:0:17257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218496896 00000100:00100000:2.0:1788832370.394520:0:17257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218496896 00000100:00100000:2.0:1788832370.394536:0:17257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788832370.394545:0:17257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218496384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832370.394597:0:17257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218496384:12345-0@lo:400:kworker.0 Request processed in 51us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832370.394616:0:17257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788832370.394690:0:17257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788832370.394696:0:17257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218496896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832370.394727:0:17257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218496896:12345-0@lo:400:kworker.0 Request processed in 31us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832370.394734:0:17257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788832370.394751:0:19717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218496512 00000100:00100000:2.0:1788832370.394755:0:19717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218496512 00000100:00100000:2.0:1788832370.394787:0:19717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218497024 00000100:00100000:2.0:1788832370.394790:0:19717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218497024 00000100:00100000:2.0:1788832370.394816:0:19717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788832370.394822:0:19717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218496512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832370.394851:0:19717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218496512:12345-0@lo:400:kworker.0 Request processed in 30us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832370.394857:0:19717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788832370.394867:0:19717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788832370.394872:0:19717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218497024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832370.394897:0:19717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218497024:12345-0@lo:400:kworker.0 Request processed in 25us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832370.394909:0:19717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788832370.394932:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218497408 00000100:00100000:2.0:1788832370.394936:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218497408 00000100:00100000:2.0:1788832370.394957:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218497536 00000100:00100000:2.0:1788832370.394960:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218497536 00000100:00100000:2.0:1788832370.394979:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788832370.394985:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218497408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832370.395013:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218497408:12345-0@lo:400:kworker.0 Request processed in 29us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832370.395019:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788832370.395029:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788832370.395035:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218497536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832370.395058:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218497536:12345-0@lo:400:kworker.0 Request processed in 24us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832370.395062:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788832370.395096:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218496512:0@lo:400:kworker.0 00000100:00100000:2.0:1788832370.395106:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218497024:0@lo:400:kworker.0 00010000:00080000:2.0:1788832370.395116:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07f0e680 x1875726218497536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788832370.395125:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218497536:0@lo:400:kworker.0 00000100:00100000:2.0:1788832370.395133:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218496384:0@lo:400:kworker.0 00000100:00100000:2.0:1788832370.395140:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218496896:0@lo:400:kworker.0 00000100:00100000:2.0:1788832370.395148:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218497408:0@lo:400:kworker.0 00000100:00100000:2.0:1788832370.395243:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218497920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788832370.395282:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832370.395302:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788832370.395309:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218498048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832370.395329:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832370.395351:0:18761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218497920 00000100:00100000:2.0:1788832370.395355:0:18761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218497920 00000100:00100000:2.0:1788832370.395382:0:18761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788832370.395389:0:18761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218497920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788832370.395411:0:18761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788832370.395443:0:18761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218497920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832370.395449:0:18761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788832370.395466:0:17257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218498048 00000100:00100000:2.0:1788832370.395469:0:17257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218498048 00000100:00100000:2.0:1788832370.395482:0:17257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788832370.395486:0:17257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218498048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788832370.395505:0:17257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788832370.395532:0:17257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218498048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 44us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832370.395538:0:17257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788832370.395567:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218498048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832370.395578:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218497920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788832370.395882:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218496640:0@lo:400:kworker.0 00000100:00100000:1.0:1788832370.395914:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832370.395934:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218497152:0@lo:400:kworker.0 00000100:00100000:1.0:1788832370.395954:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832370.395971:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218497664:0@lo:400:kworker.0 00000100:00100000:1.0:1788832370.395998:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832370.396017:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788832370.396023:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7e119a26-e2c8-49b5-8e81-f568246f48a1:3653:1875726218496256:0@lo:400:kworker.0 00000100:00100000:1.0:1788832370.396048:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832370.396071:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218496768:0@lo:400:kworker.0 00000100:00100000:1.0:1788832370.396091:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832370.396117:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218497280:0@lo:400:kworker.0 00000100:00100000:1.0:1788832370.396141:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832370.396151:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218497792:0@lo:400:kworker.0 00000100:00100000:1.0:1788832370.396171:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832370.396235:0:18760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218496640 00000100:00100000:1.0:1788832370.396240:0:18760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218496640 00000100:00100000:1.0:1788832370.396270:0:18760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218497152 00000100:00100000:1.0:1788832370.396273:0:18760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218497152 00000100:00100000:1.0:1788832370.396290:0:18760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788832370.396297:0:18760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218496640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832370.396343:0:18760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218496640:12345-0@lo:400:kworker.0 Request processed in 46us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832370.396349:0:18760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788832370.396362:0:18760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788832370.396368:0:18760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218497152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832370.396394:0:18760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218497152:12345-0@lo:400:kworker.0 Request processed in 26us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832370.396400:0:18760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788832370.396416:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218497664 00000100:00100000:1.0:1788832370.396419:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218497664 00000100:00100000:1.0:1788832370.396437:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218496768 00000100:00100000:1.0:1788832370.396440:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218496768 00000100:00100000:1.0:1788832370.396450:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218497280 00000100:00100000:1.0:1788832370.396452:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218497280 00000100:00100000:1.0:1788832370.396462:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218497792 00000100:00100000:1.0:1788832370.396464:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218497792 00000100:00100000:1.0:1788832370.396477:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788832370.396483:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218497664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832370.396520:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218497664:12345-0@lo:400:kworker.0 Request processed in 37us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832370.396527:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788832370.396539:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788832370.396544:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218496768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832370.396568:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1875726218496768:12345-0@lo:400:kworker.0 Request processed in 24us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832370.396573:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788832370.396584:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788832370.396589:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218497280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832370.396647:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218497280:12345-0@lo:400:kworker.0 Request processed in 58us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832370.396654:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788832370.396665:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788832370.396671:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218497792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832370.396695:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218497792:12345-0@lo:400:kworker.0 Request processed in 24us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832370.396701:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788832370.396718:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218496256 00000100:00100000:1.0:1788832370.396721:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218496256 00000100:00100000:1.0:1788832370.396745:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788832370.396751:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:3653:x1875726218496256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832370.396779:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:3653:x1875726218496256:12345-0@lo:400:kworker.0 Request processed in 28us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832370.396785:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788832370.396835:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218498176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832370.396858:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832370.396884:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7e119a26-e2c8-49b5-8e81-f568246f48a1:3653:1875726218496256:0@lo:400:kworker.0 00000100:00100000:1.0:1788832370.396895:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1875726218496768:0@lo:400:kworker.0 00000100:00100000:1.0:1788832370.396902:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218497280:0@lo:400:kworker.0 00010000:00080000:1.0:1788832370.396913:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07f0fb80 x1875726218497792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832370.396922:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218497792:0@lo:400:kworker.0 00000100:00100000:1.0:1788832370.396930:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788832370.396942:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218496640:0@lo:400:kworker.0 00000100:00100000:1.0:1788832370.396952:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218497152:0@lo:400:kworker.0 00000100:00100000:1.0:1788832370.396962:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218497664:0@lo:400:kworker.0 00000100:00100000:1.0:1788832370.397003:0:18761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218498176 00000100:00100000:1.0:1788832370.397008:0:18761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218498176 00000100:00100000:1.0:1788832370.397032:0:18761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788832370.397038:0:18761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218498176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788832370.397050:0:18761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788832370.397083:0:18761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218498176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832370.397088:0:18761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788832370.397116:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218498176:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788832370.397402:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788832370.397408:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788832370.397410:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788832370.397412:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788832370.397420:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788832370.397428:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218498304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788832370.397456:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832370.397478:0:18761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218498304 00000100:00100000:0.0:1788832370.397482:0:18761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218498304 00000100:00100000:0.0:1788832370.397507:0:18761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788832370.397513:0:18761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218498304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788832370.397529:0:18761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788832370.397560:0:18761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218498304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832370.397566:0:18761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788832370.397595:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218498304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832370.399452:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218498432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788832370.399511:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832370.399569:0:17257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218498432 00000100:00100000:2.0:1788832370.399576:0:17257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218498432 00000100:00100000:2.0:1788832370.399642:0:17257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788832370.399650:0:17257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218498432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788832370.399678:0:17257:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788832370.399721:0:17257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218498432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832370.399728:0:17257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788832370.399766:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218498432:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788832370.582784:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788832371.415905:0:18007:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788832371.612732:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788832371.939905:0:19571:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6 00000001:00100000:1.0:1788832371.939918:0:19571:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be 00000001:00100000:0.0:1788832371.940065:0:18754:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6 00000001:00100000:0.0:1788832371.940081:0:18754:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be 00000001:00100000:3.0:1788832371.942269:0:17985:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6 00000001:00100000:3.0:1788832371.942287:0:17985:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be 00000001:00100000:1.0:1788832371.945577:0:17231:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6 00000001:00100000:1.0:1788832371.945604:0:17231:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be 00000001:02000400:1.0:1788832372.097015:0:20132:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788832372.633125:0:19721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832373.655674:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832373.971681:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832373.972667:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202694144 00000100:00100000:0.0:1788832373.972682:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202694144 00000100:00100000:0.0:1788832373.972758:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 146 00000100:00100000:0.0:1788832373.972778:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:2393:x1875726202694144:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832373.973157:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:2393:x1875726202694144:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 389us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832373.973180:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 146 00000100:00100000:1.0:1788832373.973317:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832373.974051:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202694272 00000100:00100000:3.0:1788832373.974061:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202694272 00000100:00100000:3.0:1788832373.974204:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:3.0:1788832373.974216:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:2393:x1875726202694272:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832373.974296:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:2393:x1875726202694272:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 82us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832373.974304:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:1.0:1788832373.974422:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832373.974533:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832373.974555:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832373.974588:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832373.974614:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832373.974678:0:18759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202694528 00000100:00100000:1.0:1788832373.974683:0:18759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202694528 00000100:00100000:1.0:1788832373.974718:0:18759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202694656 00000100:00100000:1.0:1788832373.974721:0:18759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202694656 00000100:00100000:1.0:1788832373.974743:0:18759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202695168 00000100:00100000:1.0:1788832373.974746:0:18759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202695168 00000100:00080000:0.0:1788832373.974883:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788832373.974888:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788832373.974892:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832373.974903:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202694400 00000100:00100000:0.0:1788832373.974906:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202694400 00000100:00100000:0.0:1788832373.974940:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202694912 00000100:00100000:0.0:1788832373.974944:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202694912 00000100:00100000:0.0:1788832373.974967:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:0.0:1788832373.974975:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:2393:x1875726202694400:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832373.975024:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:2393:x1875726202694400:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 50us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832373.975031:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:0.0:1788832373.975046:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:0.0:1788832373.975052:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+5:2393:x1875726202694912:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832373.975076:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+5:2393:x1875726202694912:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 24us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832373.975083:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00080000:0.0:1788832373.975101:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788832373.975406:0:19714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:3.0:1788832373.975417:0:19714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:2394:x1875726202694528:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832373.975543:0:18759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:1.0:1788832373.975552:0:18759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:2393:x1875726202694656:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832373.975595:0:18759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:2393:x1875726202694656:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 44us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832373.975602:0:18759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:1.0:1788832373.975647:0:18759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:1.0:1788832373.975656:0:18759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+5:2393:x1875726202695168:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:1.0:1788832373.975683:0:18759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+5:2393:x1875726202695168:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 29us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832373.975703:0:18759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:3.0:1788832373.976844:0:19714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:2394:x1875726202694528:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 1419us (2411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832373.976857:0:19714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 12 00000100:00100000:0.0:1788832373.978325:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832373.978424:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832373.979050:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202694784 00000100:00100000:3.0:1788832373.979064:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202694784 00000100:00100000:3.0:1788832373.979381:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:3.0:1788832373.979395:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:2394:x1875726202694784:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832373.979503:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:2394:x1875726202694784:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 110us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832373.979512:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:3.0:1788832373.979680:0:19715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202695040 00000100:00100000:3.0:1788832373.979686:0:19715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202695040 00000100:00100000:3.0:1788832373.979724:0:19715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:3.0:1788832373.979732:0:19715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+5:2394:x1875726202695040:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832373.979765:0:19715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+5:2394:x1875726202695040:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 34us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832373.979772:0:19715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00080000:1.0:1788832373.980281:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788832373.980290:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788832374.679935:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832374.999228:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218498560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788832374.999345:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832374.999452:0:18761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218498560 00000100:00100000:2.0:1788832374.999462:0:18761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218498560 00000100:00100000:2.0:1788832374.999548:0:18761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788832374.999561:0:18761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218498560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788832374.999611:0:18761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1788832375.000007:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832375.001410:0:18761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218498560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1826us (2041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832375.001433:0:18761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788832375.001644:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218498560:0@lo:13:osp-pre-0-1.0 00000020:00000080:1.0:1788832375.456280:0:20280:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda4a67000 20000000:00000080:1.0:1788832375.456300:0:20280:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d2c1f87fc00 uarg=0000000000000000 20000000:01000000:1.0:1788832375.456343:0:20280:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788832375.456349:0:20280:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788832375.456354:0:20280:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788832375.458343:0:20281:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788832375.459266:0:20280:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788832375.466597:0:20280:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788832375.466716:0:20280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d2c3050a000/0x998c12b28353863e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.466735:0:20280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835382cc expref: 23 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.466743:0:20280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c421d3000/0x998c12b2835382e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835382da expref: 23 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.466750:0:20280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2b07cfe000/0x998c12b283538320 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283538319 expref: 23 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.466756:0:20280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2b07cffa00/0x998c12b2835383ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b2835383b3 expref: 23 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.466767:0:20280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c3050b000/0x998c12b2835385ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a5b expref: 12 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.466793:0:20280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d2c3050ae00/0x998c12b28353860d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04acb expref: 12 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.466801:0:20280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d2c3050a000/0x998c12b28353863e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.466850:0:20280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c3050ae00/0x998c12b28353860d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04acb expref: 12 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.466866:0:20280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2c3050ae00/0x998c12b28353860d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04acb expref: 12 pid: 17245 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832375.466881:0:20280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20280:1875726218498688:192.168.203.26@tcp:104: 00010000:00010000:1.0:1788832375.467309:0:20280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c3050b000/0x998c12b2835385ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a5b expref: 12 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.467319:0:20280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2c3050b000/0x998c12b2835385ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a5b expref: 12 pid: 17244 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832375.467328:0:20280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe26d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20280:1875726218498816:192.168.203.26@tcp:104: 00010000:00010000:1.0:1788832375.467377:0:20280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2b07cffa00/0x998c12b2835383ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b2835383b3 expref: 23 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.467386:0:20280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2b07cffa00/0x998c12b2835383ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b2835383b3 expref: 23 pid: 17244 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832375.467395:0:20280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe27100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20280:1875726218498944:0@lo:104: 00000100:00100000:1.0:1788832375.467434:0:20280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788832375.467489:0:20280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2b07cfe000/0x998c12b283538320 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b283538319 expref: 23 pid: 17244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.467497:0:20280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2b07cfe000/0x998c12b283538320 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b283538319 expref: 23 pid: 17244 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832375.467505:0:20280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c1fe24e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20280:1875726218499072:0@lo:104: 00000100:00100000:1.0:1788832375.467525:0:20280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832375.467557:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218498944 00000100:00100000:1.0:1788832375.467564:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218498944 00000100:00100000:1.0:1788832375.467642:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218499072 00000100:00100000:1.0:1788832375.467646:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218499072 00000100:00100000:1.0:1788832375.467681:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788832375.467690:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e119a26-e2c8-49b5-8e81-f568246f48a1+4:20280:x1875726218498944:12345-0@lo:104: 00010000:00010000:1.0:1788832375.467702:0:17235:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b2835383b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b2835383ba expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.467758:0:17235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788832375.467764:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e119a26-e2c8-49b5-8e81-f568246f48a1+4:20280:x1875726218498944:12345-0@lo:104: Request processed in 76us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832375.467771:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788832375.467794:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788832375.467801:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e119a26-e2c8-49b5-8e81-f568246f48a1+3:20280:x1875726218499072:12345-0@lo:104: 00010000:00010000:1.0:1788832375.467808:0:17235:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c01229a00/0x998c12b283538319 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283538320 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.467838:0:17235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788832375.467842:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e119a26-e2c8-49b5-8e81-f568246f48a1+3:20280:x1875726218499072:12345-0@lo:104: Request processed in 43us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832375.467857:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788832375.467888:0:20280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c421d3000/0x998c12b2835382e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b2835382da expref: 23 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.467898:0:20280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2c421d3000/0x998c12b2835382e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b2835382da expref: 23 pid: 17245 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832375.467907:0:20280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f34700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20280:1875726218499200:0@lo:104: 00000100:00100000:1.0:1788832375.467930:0:20280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832375.467950:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218499200 00000100:00100000:1.0:1788832375.467954:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218499200 00000100:00100000:1.0:1788832375.467971:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788832375.467976:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e119a26-e2c8-49b5-8e81-f568246f48a1+3:20280:x1875726218499200:12345-0@lo:104: 00010000:00010000:1.0:1788832375.467984:0:17235:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2b07cffe00/0x998c12b2835382da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b2835382e1 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.468015:0:17235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788832375.468019:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e119a26-e2c8-49b5-8e81-f568246f48a1+3:20280:x1875726218499200:12345-0@lo:104: Request processed in 44us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832375.468025:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788832375.468053:0:20280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x998c12b2835382cc expref: 23 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.468061:0:20280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x998c12b2835382cc expref: 23 pid: 17245 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832375.468070:0:20280:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20280:1875726218499328:0@lo:104: 00000100:00100000:1.0:1788832375.468091:0:20280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832375.468117:0:17235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218499328 00000100:00100000:1.0:1788832375.468120:0:17235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218499328 00000100:00100000:1.0:1788832375.468136:0:17235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788832375.468142:0:17235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e119a26-e2c8-49b5-8e81-f568246f48a1+3:20280:x1875726218499328:12345-0@lo:104: 00010000:00010000:1.0:1788832375.468149:0:17235:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0dc00/0x998c12b2835382cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b2835382d3 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.468177:0:17235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788832375.468182:0:17235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e119a26-e2c8-49b5-8e81-f568246f48a1+3:20280:x1875726218499328:12345-0@lo:104: Request processed in 40us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832375.468187:0:17235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788832375.468206:0:20280:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c032a6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788832375.468230:0:20280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe27100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20280:1875726218498944:0@lo:104: 00000100:00100000:1.0:1788832375.468238:0:20280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20280:1875726218499072:0@lo:104: 00000100:00100000:1.0:1788832375.468244:0:20280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f34700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20280:1875726218499200:0@lo:104: 00000100:00100000:1.0:1788832375.468250:0:20280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20280:1875726218499328:0@lo:104: 00010000:00010000:3.0:1788832375.468294:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788832375.468302:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b2835383b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b2835383ba expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832375.468803:0:19721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788832375.468809:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0c200 already unused, calling callback (ffffffffc140fc20) 00010000:00010000:2.0:1788832375.468810:0:19721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c01229a00/0x998c12b283538319 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b283538320 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832375.468814:0:17239:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b2835383b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b2835383ba expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832375.468817:0:19721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01229a00 already unused, calling callback (ffffffffc140fc20) 00010000:00010000:3.0:1788832375.468822:0:17239:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b2835383b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b2835383ba expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788832375.468828:0:19721:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c01229a00/0x998c12b283538319 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b283538320 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788832375.468829:0:17239:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b2835383b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b2835383ba expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832375.468835:0:19721:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c01229a00/0x998c12b283538319 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b283538320 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832375.468836:0:17239:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:2.0:1788832375.468841:0:19721:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c01229a00/0x998c12b283538319 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b283538320 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832375.468845:0:19721:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788832375.468899:0:17239:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b2835383b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835383ba expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832375.468907:0:17240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788832375.469016:0:19721:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c01229a00/0x998c12b283538319 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283538320 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832375.469023:0:19721:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832375.469057:0:19721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c01229a00/0x998c12b283538319 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283538320 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832375.469064:0:19721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c01229a00/0x998c12b283538319 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b283538320 expref: -99 pid: 18753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832375.469077:0:19721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788832375.469081:0:19721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0dc00/0x998c12b2835382cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b2835382d3 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832375.469086:0:19721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c1fe0dc00 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:0.0:1788832375.469088:0:19721:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0dc00/0x998c12b2835382cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b2835382d3 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832375.469094:0:19721:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0dc00/0x998c12b2835382cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b2835382d3 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788832375.469100:0:19721:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0dc00/0x998c12b2835382cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b2835382d3 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788832375.469106:0:19721:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788832375.469123:0:19721:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0dc00/0x998c12b2835382cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835382d3 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832375.469129:0:19721:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788832375.469135:0:19721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0dc00/0x998c12b2835382cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835382d3 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832375.469140:0:19721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0dc00/0x998c12b2835382cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835382d3 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832375.469159:0:19721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832375.469161:0:19721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832375.469163:0:19721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832375.469183:0:17239:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788832375.469185:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e119a26-e2c8-49b5-8e81-f568246f48a1:3654:1875726218499712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788832375.469201:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b2835383b3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835383ba expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832375.469218:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2c1fe0c200/0x998c12b2835383b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835383ba expref: -99 pid: 19570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832375.469224:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788832375.469228:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832375.469230:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788832375.469232:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832375.469242:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b08550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e119a26-e2c8-49b5-8e81-f568246f48a1:3651:1875726218499456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788832375.469247:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788832375.469252:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e119a26-e2c8-49b5-8e81-f568246f48a1:3654:1875726218499584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788832375.469267:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832375.469293:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832375.469320:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218499712 00000100:00100000:0.0:1788832375.469325:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218499712 00010000:00010000:0.0:1788832375.469451:0:17238:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b2835382cc expref: 24 pid: 17245 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832375.469473:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218499584 00000100:00100000:0.0:1788832375.469476:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218499584 00010000:00010000:0.0:1788832375.469489:0:17238:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2b07cfe000/0x998c12b283538320 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283538319 expref: 25 pid: 17244 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832375.469501:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218499456 00000100:00100000:0.0:1788832375.469503:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218499456 00010000:00010000:0.0:1788832375.469514:0:17238:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2b07cffa00/0x998c12b2835383ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b2835383b3 expref: 26 pid: 17244 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832375.469527:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788832375.469534:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e119a26-e2c8-49b5-8e81-f568246f48a1+26:3654:x1875726218499712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832375.469545:0:17238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832375.469549:0:17238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b2835382cc expref: 26 pid: 17245 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832375.469578:0:17238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b2835382cc expref: 26 pid: 17245 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832375.469592:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c421d2c00/0x998c12b2835382d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b2835382cc expref: 26 pid: 17245 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832375.469605:0:17238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832375.469664:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e119a26-e2c8-49b5-8e81-f568246f48a1+25:3654:x1875726218499712:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832375.469671:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788832375.469686:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788832375.469692:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:3654:x1875726218499584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832375.469701:0:17238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832375.469705:0:17238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2b07cfe000/0x998c12b283538320 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b283538319 expref: 24 pid: 17244 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832375.469712:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e119a26-e2c8-49b5-8e81-f568246f48a1:3654:1875726218499712:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832375.469712:0:17238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2b07cfe000/0x998c12b283538320 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b283538319 expref: 24 pid: 17244 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832375.469721:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2b07cfe000/0x998c12b283538320 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b283538319 expref: 24 pid: 17244 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832375.469729:0:17238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832375.469762:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e119a26-e2c8-49b5-8e81-f568246f48a1+23:3654:x1875726218499584:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832375.469768:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788832375.469781:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788832375.469787:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e119a26-e2c8-49b5-8e81-f568246f48a1+22:3651:x1875726218499456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832375.469801:0:17238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832375.469805:0:17238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2b07cffa00/0x998c12b2835383ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b2835383b3 expref: 22 pid: 17244 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832375.469813:0:17238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2b07cffa00/0x998c12b2835383ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b2835383b3 expref: 22 pid: 17244 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832375.469823:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2b07cffa00/0x998c12b2835383ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b2835383b3 expref: 22 pid: 17244 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832375.469831:0:17238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832375.469861:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:3651:x1875726218499456:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832375.469867:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b08550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e119a26-e2c8-49b5-8e81-f568246f48a1:3651:1875726218499456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788832375.469867:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788832375.469901:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e119a26-e2c8-49b5-8e81-f568246f48a1:3654:1875726218499584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788832375.471182:0:20282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832375.471187:0:20282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788832375.471189:0:20282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832375.471228:0:17240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff9d2b07cffe00/0x998c12b2835382da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x998c12b2835382e1 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.471239:0:17240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cffe00 already unused, calling callback (ffffffffc140fc20) 10000000:00010000:1.0:1788832375.471243:0:17240:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff9d2b07cffe00/0x998c12b2835382da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x998c12b2835382e1 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.471252:0:17240:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff9d2b07cffe00/0x998c12b2835382da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x998c12b2835382e1 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788832375.471259:0:17240:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff9d2b07cffe00/0x998c12b2835382da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x998c12b2835382e1 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788832375.471276:0:17240:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788832375.471322:0:17240:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.126@tcp lock: ffff9d2b07cffe00/0x998c12b2835382da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835382e1 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.471328:0:17240:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788832375.471361:0:17240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff9d2b07cffe00/0x998c12b2835382da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835382e1 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.471368:0:17240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff9d2b07cffe00/0x998c12b2835382da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x998c12b2835382e1 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.471383:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832375.471385:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832375.471387:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832375.471431:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e119a26-e2c8-49b5-8e81-f568246f48a1:3652:1875726218499840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788832375.471485:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832375.471814:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218499840 00000100:00100000:1.0:1788832375.471821:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218499840 00010000:00010000:1.0:1788832375.471846:0:17238:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c421d3000/0x998c12b2835382e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b2835382da expref: 21 pid: 17245 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832375.471886:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788832375.471893:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07dded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:3652:x1875726218499840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788832375.471904:0:17238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832375.471909:0:17238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c421d3000/0x998c12b2835382e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x998c12b2835382da expref: 21 pid: 17245 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.471919:0:17238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c421d3000/0x998c12b2835382e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x998c12b2835382da expref: 21 pid: 17245 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.471933:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c421d3000/0x998c12b2835382e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x998c12b2835382da expref: 21 pid: 17245 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.471952:0:17238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832375.471988:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07dded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7e119a26-e2c8-49b5-8e81-f568246f48a1+20:3652:x1875726218499840:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832375.471995:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788832375.472067:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e119a26-e2c8-49b5-8e81-f568246f48a1:3652:1875726218499840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788832375.473210:0:20280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe24000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20280:1875726218498688:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788832375.473224:0:20280:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c1fe26d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20280:1875726218498816:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788832375.473262:0:20280:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d2c3050a000/0x998c12b28353863e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832375.474585:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832375.474670:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202695296 00000100:00100000:2.0:1788832375.474679:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202695296 00010000:00010000:2.0:1788832375.474713:0:17236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c3050ae00/0x998c12b28353860d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04acb expref: 13 pid: 17245 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832375.474746:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:2.0:1788832375.474755:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36f87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:2394:x1875726202695296:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832375.474767:0:17236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832375.474773:0:17236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c3050ae00/0x998c12b28353860d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04acb expref: 13 pid: 17245 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832375.474784:0:17236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c3050ae00/0x998c12b28353860d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04acb expref: 13 pid: 17245 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832375.474799:0:17236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c3050ae00/0x998c12b28353860d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04acb expref: 13 pid: 17245 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832375.474810:0:17236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832375.474858:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36f87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+12:2394:x1875726202695296:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 104us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832375.474878:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 13 00000100:00100000:1.0:1788832375.477361:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832375.477528:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202695424 00000100:00100000:3.0:1788832375.477536:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202695424 00010000:00010000:3.0:1788832375.477577:0:17237:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d2c3050b000/0x998c12b2835385ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a5b expref: 12 pid: 17244 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832375.477647:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 14 00000100:00100000:3.0:1788832375.477672:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+12:2393:x1875726202695424:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832375.477685:0:17237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832375.477691:0:17237:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d2c3050b000/0x998c12b2835385ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a5b expref: 12 pid: 17244 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832375.477703:0:17237:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d2c3050b000/0x998c12b2835385ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a5b expref: 12 pid: 17244 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832375.477722:0:17237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c3050b000/0x998c12b2835385ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a5b expref: 12 pid: 17244 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832375.477736:0:17237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d2c3050a000/0x998c12b28353863e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832375.477745:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c3050a000/0x998c12b28353863e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832375.477760:0:17237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c3050a000/0x998c12b28353863e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832375.477768:0:17237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d2c3050a000/0x998c12b28353863e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832375.477774:0:17237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d2c3050a000/0x998c12b28353863e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832375.477781:0:17237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d2c3050a000/0x998c12b28353863e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832375.477788:0:17237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c3050a000 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:3.0:1788832375.477793:0:17237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d2c3050a000/0x998c12b28353863e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832375.477808:0:17237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d2c3050a000/0x998c12b28353863e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832375.477825:0:17237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d2c3050a000/0x998c12b28353863e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832375.477836:0:17237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832375.477884:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+11:2393:x1875726202695424:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 215us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832375.477892:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 14 00010000:00010000:1.0:1788832375.478101:0:20280:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d2c3050a000/0x998c12b28353863e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.478111:0:20280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d2c3050a000/0x998c12b28353863e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832375.478118:0:20280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d2c3050a000/0x998c12b28353863e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832375.512731:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788832375.512759:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218499968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788832375.513083:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218500480:0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.517103:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832375.517153:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218500992:0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.517193:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832375.517211:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218501504:0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.517235:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832375.517264:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788832375.517271:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218500096:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788832375.517293:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832375.517311:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218500608:0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.517332:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832375.517348:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218501120:0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.517368:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832375.517385:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218501632:0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.517403:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832375.517430:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218500224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788832375.517454:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832375.517472:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218500736:0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.517491:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832375.517507:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218501248:0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.517525:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832375.517533:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218501760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832375.517564:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832375.517597:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788832375.517604:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218500352:0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.517643:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832375.517659:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218500864:0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.517678:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832375.517696:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218501376:0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.517715:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832375.517723:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218501888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832375.517742:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832375.517773:0:19717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218500480 00000100:00100000:2.0:1788832375.517780:0:19717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218500480 00000100:00100000:2.0:1788832375.517845:0:19717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218500992 00000100:00100000:2.0:1788832375.517849:0:19717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218500992 00000100:00100000:2.0:1788832375.517867:0:19717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218500608 00000100:00100000:2.0:1788832375.517871:0:19717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218500608 00000100:00100000:2.0:1788832375.517892:0:19717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788832375.517900:0:19717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218500480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.519947:0:19717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218500480:12345-0@lo:400:kworker.0 Request processed in 2040us (2841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832375.519961:0:19717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788832375.519995:0:19717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788832375.520009:0:19717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218500992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.520073:0:19717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218500992:12345-0@lo:400:kworker.0 Request processed in 71us (2879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832375.520080:0:19717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788832375.520102:0:19717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788832375.520108:0:19717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218500608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.520139:0:19717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218500608:12345-0@lo:400:kworker.0 Request processed in 32us (2806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832375.520145:0:19717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788832375.520171:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218501504 00000100:00100000:2.0:1788832375.520178:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218501504 00000100:00100000:2.0:1788832375.520208:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218501120 00000100:00100000:2.0:1788832375.520211:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218501120 00000100:00100000:2.0:1788832375.520221:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218501632 00000100:00100000:2.0:1788832375.520224:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218501632 00000100:00100000:2.0:1788832375.520236:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218500736 00000100:00100000:2.0:1788832375.520239:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218500736 00000100:00100000:2.0:1788832375.520248:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218501248 00000100:00100000:2.0:1788832375.520250:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218501248 00000100:00100000:2.0:1788832375.520264:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218501376 00000100:00100000:2.0:1788832375.520266:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218501376 00000100:00100000:2.0:1788832375.520280:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788832375.520287:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218501504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.520318:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218501504:12345-0@lo:400:kworker.0 Request processed in 32us (3082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832375.520324:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788832375.520336:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788832375.520342:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218501120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.520369:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218501120:12345-0@lo:400:kworker.0 Request processed in 27us (3001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832375.520375:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788832375.520385:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788832375.520391:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218501632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.520429:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218501632:12345-0@lo:400:kworker.0 Request processed in 38us (3025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832375.520436:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788832375.520447:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788832375.520453:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218500736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.520495:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1875726218500736:12345-0@lo:400:kworker.0 Request processed in 42us (3002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832375.520501:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788832375.520512:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788832375.520518:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218501248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.520545:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1875726218501248:12345-0@lo:400:kworker.0 Request processed in 27us (3019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832375.520550:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788832375.520561:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788832375.520566:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218501376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.520608:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1875726218501376:12345-0@lo:400:kworker.0 Request processed in 42us (2892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832375.520614:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788832375.520661:0:18308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218500224 00000100:00100000:2.0:1788832375.520666:0:18308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218500224 00000100:00100000:2.0:1788832375.520683:0:18308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218500352 00000100:00100000:2.0:1788832375.520686:0:18308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218500352 00000100:00100000:2.0:1788832375.520694:0:18308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218500864 00000100:00100000:2.0:1788832375.520696:0:18308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218500864 00000100:00100000:2.0:1788832375.520707:0:18308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788832375.520712:0:18308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1875726218500224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788832375.520747:0:18308:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788832375.520781:0:18308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3651:x1875726218500224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (3325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832375.520788:0:18308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788832375.520800:0:18308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788832375.520805:0:18308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218500352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.520932:0:18308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218500352:12345-0@lo:400:kworker.0 Request processed in 125us (3287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832375.520938:0:18308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788832375.520951:0:18308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788832375.520957:0:18308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218500864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832375.520986:0:18308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1875726218500864:12345-0@lo:400:kworker.0 Request processed in 29us (3306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832375.520992:0:18308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788832375.521017:0:18761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218500096 00000100:00100000:2.0:1788832375.521021:0:18761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218500096 00000100:00100000:2.0:1788832375.521038:0:18761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218501760 00000100:00100000:2.0:1788832375.521041:0:18761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218501760 00000100:00100000:2.0:1788832375.521049:0:18761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218501888 00000100:00100000:2.0:1788832375.521051:0:18761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218501888 00000100:00100000:2.0:1788832375.521062:0:18761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788832375.521068:0:18761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218500096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788832375.521088:0:18761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788832375.521122:0:18761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218500096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (3827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832375.521128:0:18761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788832375.521146:0:18761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788832375.521152:0:18761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218501760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788832375.521161:0:18761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788832375.521187:0:18761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218501760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (3622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832375.521193:0:18761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788832375.521204:0:18761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788832375.521209:0:18761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218501888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788832375.521219:0:18761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788832375.521246:0:18761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1875726218501888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (3504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832375.521252:0:18761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788832375.521275:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788832375.521279:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788832375.521282:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788832375.521284:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788832375.521958:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218500352:0@lo:400:kworker.0 00000100:00100000:1.0:1788832375.521973:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218500864:0@lo:400:kworker.0 00010000:00080000:1.0:1788832375.521987:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcb7100 x1875726218501376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788832375.521998:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1875726218501376:0@lo:400:kworker.0 00000100:00100000:1.0:1788832375.522017:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218501888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788832375.522029:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218500224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788832375.522039:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1875726218500736:0@lo:400:kworker.0 00000100:00100000:1.0:1788832375.522049:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1875726218501248:0@lo:400:kworker.0 00000100:00100000:1.0:1788832375.522074:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218501760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788832375.522408:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218500480:0@lo:400:kworker.0 00000100:00100000:0.0:1788832375.522420:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218500992:0@lo:400:kworker.0 00000100:00100000:0.0:1788832375.522430:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218501504:0@lo:400:kworker.0 00000100:00100000:0.0:1788832375.522453:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218500096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788832375.522472:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218500608:0@lo:400:kworker.0 00000100:00100000:0.0:1788832375.522483:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218501120:0@lo:400:kworker.0 00010000:00080000:0.0:1788832375.522494:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fcb6680 x1875726218501632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832375.522503:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fcb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218501632:0@lo:400:kworker.0 00000100:00100000:3.0:1788832375.522617:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832375.525171:0:18308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218499968 00000100:00100000:0.0:1788832375.525184:0:18308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218499968 00000100:00100000:0.0:1788832375.525235:0:18308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788832375.525244:0:18308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218499968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788832375.525281:0:18308:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788832375.525382:0:18308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218499968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (2764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832375.525389:0:18308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788832375.532102:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218499968:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788832375.703317:0:19721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788832376.731987:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832377.235396:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832377.235480:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202695552 00000100:00100000:1.0:1788832377.235490:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202695552 00000100:00100000:1.0:1788832377.235548:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 147 00000100:00100000:1.0:1788832377.235569:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+11:14930:x1875726202695552:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788832377.235587:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832377.235609:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c3050b400/0x998c12b283538645 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b03 expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832377.235675:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c3050b400/0x998c12b283538645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b03 expref: 12 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832377.235687:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c3050b400/0x998c12b283538645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b03 expref: 12 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832377.235695:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c3050b400, rc 0) 00000100:00100000:1.0:1788832377.235750:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+12:14930:x1875726202695552:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 194us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832377.235757:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 147 00000100:00100000:0.0:1788832377.250474:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832377.251215:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202695680 00000100:00100000:3.0:1788832377.251227:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202695680 00000100:00100000:3.0:1788832377.251294:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 148 00000100:00100000:3.0:1788832377.251305:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+12:14930:x1875726202695680:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832377.251476:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+12:14930:x1875726202695680:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 172us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832377.251484:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 148 00000100:00100000:1.0:1788832377.266914:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832377.275804:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202695808 00000100:00100000:3.0:1788832377.275818:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202695808 00000100:00100000:3.0:1788832377.275885:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 149 00000100:00100000:3.0:1788832377.275895:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+12:14930:x1875726202695808:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832377.276051:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+12:14930:x1875726202695808:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 156us (9145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832377.276059:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 149 00000100:00100000:1.0:1788832377.281261:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832377.282182:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202695936 00000100:00100000:3.0:1788832377.282194:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202695936 00000100:00100000:3.0:1788832377.282261:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 150 00000100:00100000:3.0:1788832377.282271:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+12:14930:x1875726202695936:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832377.282298:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832377.282316:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c00031600/0x998c12b28353864c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b0a expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832377.282344:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c00031600/0x998c12b28353864c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b0a expref: 13 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832377.282355:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c00031600/0x998c12b28353864c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b0a expref: 13 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832377.282365:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031600, rc 0) 00000100:00100000:3.0:1788832377.282414:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:14930:x1875726202695936:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 146us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832377.282421:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 150 00000100:00100000:1.0:1788832377.284763:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832377.284839:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202696064 00000100:00100000:3.0:1788832377.284848:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202696064 00000100:00100000:3.0:1788832377.284902:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 151 00000100:00100000:3.0:1788832377.284912:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:14930:x1875726202696064:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832377.285052:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:14930:x1875726202696064:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 142us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832377.285088:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 151 00000100:00100000:0.0:1788832377.292845:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832377.295677:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202696192 00000100:00100000:3.0:1788832377.295694:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202696192 00000100:00100000:3.0:1788832377.295753:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 152 00000100:00100000:3.0:1788832377.295764:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:14930:x1875726202696192:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832377.295913:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:14930:x1875726202696192:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 150us (3076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832377.295921:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 152 10000000:01000000:2.0:1788832377.302890:0:17247:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788832377.302899:0:17247:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2b0646a000 from 13 10000000:01000000:2.0:1788832377.302904:0:17247:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788832377.302950:0:17247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c01229800/0x998c12b283538653 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832377.302963:0:17247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c01229800/0x998c12b283538653 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832377.302973:0:17247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c01229800/0x998c12b283538653 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832377.302998:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218502016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788832377.303072:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832377.303121:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832377.303189:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218502016 00000100:00100000:3.0:1788832377.303197:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218502016 00000100:00100000:3.0:1788832377.303253:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788832377.303263:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18d07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+20:17247:x1875726218502016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832377.303287:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832377.303301:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c00031c00/0x998c12b28353865a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283538653 expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832377.303323:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c00031c00/0x998c12b28353865a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283538653 expref: 21 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832377.303333:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c00031c00/0x998c12b28353865a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283538653 expref: 21 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832377.303342:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031c00, rc 0) 00000100:00100000:3.0:1788832377.303390:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18d07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:17247:x1875726218502016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832377.303397:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788832377.303542:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218502016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832377.303565:0:17247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c01229800/0x998c12b283538653 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353865a expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832377.303574:0:17247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c01229800/0x998c12b283538653 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b28353865a expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832377.303668:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218502144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832377.303700:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832377.303721:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832377.303940:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218502144 00000100:00100000:3.0:1788832377.303945:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218502144 00000100:00100000:3.0:1788832377.303981:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788832377.303988:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18d07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:17247:x1875726218502144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832377.304095:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18d07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:17247:x1875726218502144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832377.304103:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788832377.304405:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218502144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832377.304438:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218502272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832377.304480:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832377.304503:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788832377.304547:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218502272 00000100:00100000:3.0:1788832377.304552:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218502272 00000100:00100000:3.0:1788832377.304593:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788832377.304599:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18d05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:17247:x1875726218502272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832377.304703:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18d05850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:17247:x1875726218502272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832377.304709:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788832377.304794:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218502272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788832377.305845:0:20379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788832377.306115:0:17247:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788832377.306135:0:17247:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788832377.306145:0:17247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c01229800/0x998c12b283538653 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353865a expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832377.306364:0:17247:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c01229800/0x998c12b283538653 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b28353865a expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832377.306374:0:17247:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788832377.306376:0:17247:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2b073a5800 from 13 10000000:01000000:3.0:1788832377.306379:0:17247:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788832377.306410:0:17247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c00031400/0x998c12b283538661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832377.306418:0:17247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c00031400/0x998c12b283538661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832377.306438:0:17247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c00031400/0x998c12b283538661 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832377.306459:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07dde300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218502400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788832377.306513:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832377.306554:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c35803540 going to sleep for 11 seconds 00000100:00100000:2.0:1788832377.307522:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218502400 00000100:00100000:2.0:1788832377.307531:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218502400 00000100:00100000:2.0:1788832377.307592:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788832377.307603:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18d04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+21:17247:x1875726218502400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832377.307747:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832377.307765:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c01228000/0x998c12b283538668 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b283538661 expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832377.307805:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c01228000/0x998c12b283538668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b283538661 expref: 22 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832377.307817:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c01228000/0x998c12b283538668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b283538661 expref: 22 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832377.307825:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c01228000, rc 0) 00000100:00100000:2.0:1788832377.307933:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18d04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+22:17247:x1875726218502400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 331us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832377.307940:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788832377.313025:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07dde300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218502400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832377.313055:0:17247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c00031400/0x998c12b283538661 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538668 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832377.313068:0:17247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c00031400/0x998c12b283538661 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283538668 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832377.313431:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218502528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832377.313493:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832377.313582:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832377.314992:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218502528 00000100:00100000:0.0:1788832377.315005:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218502528 00000100:00100000:2.0:1788832377.315356:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788832377.315367:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+22:17247:x1875726218502528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832377.315522:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+22:17247:x1875726218502528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (2028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832377.315531:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788832377.315643:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218502528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832377.315690:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218502656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788832377.315736:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832377.315961:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06773780 going to sleep for 11 seconds 00000100:00100000:3.0:1788832377.316022:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218502656 00000100:00100000:3.0:1788832377.316028:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218502656 00000100:00100000:3.0:1788832377.316053:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788832377.316059:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c18d05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+22:17247:x1875726218502656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832377.316150:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c18d05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+22:17247:x1875726218502656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832377.316439:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788832377.316526:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218502656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788832377.317648:0:20380:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788832377.317965:0:17247:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788832377.317987:0:17247:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788832377.317998:0:17247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c00031400/0x998c12b283538661 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538668 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832377.318011:0:17247:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c00031400/0x998c12b283538661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538668 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788832377.318021:0:17247:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788832377.318024:0:17247:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2c3fc69800 from 13 10000000:01000000:3.0:1788832377.318027:0:17247:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788832377.318063:0:17247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b28353866f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832377.318072:0:17247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b28353866f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832377.318094:0:17247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b28353866f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832377.318116:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07dde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218502784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788832377.318167:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832377.318211:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c358033c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832377.318381:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218502784 00000100:00100000:0.0:1788832377.318388:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218502784 00000100:00100000:0.0:1788832377.318426:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788832377.318434:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+22:17247:x1875726218502784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788832377.318446:0:17243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832377.318460:0:17243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c092ddc00/0x998c12b283538676 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b28353866f expref: -99 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832377.318479:0:17243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c092ddc00/0x998c12b283538676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b28353866f expref: 23 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832377.318489:0:17243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c092ddc00/0x998c12b283538676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b28353866f expref: 23 pid: 17243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832377.318497:0:17243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092ddc00, rc 0) 00000100:00100000:0.0:1788832377.318542:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+23:17247:x1875726218502784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832377.318548:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788832377.318658:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07dde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218502784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788832377.318672:0:17247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b28353866f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538676 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832377.318681:0:17247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b28353866f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283538676 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832377.318734:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07dde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218502912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832377.318759:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832377.318775:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c358033c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832377.318841:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218502912 00000100:00100000:0.0:1788832377.318845:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218502912 00000100:00100000:0.0:1788832377.318863:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788832377.318869:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+23:17247:x1875726218502912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788832377.318979:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+23:17247:x1875726218502912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832377.318986:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788832377.319054:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07dde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218502912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788832377.319080:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07dde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218503040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788832377.319119:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832377.319149:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c358033c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788832377.319417:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218503040 00000100:00100000:2.0:1788832377.319423:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218503040 00000100:00100000:2.0:1788832377.319448:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788832377.319455:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+23:17247:x1875726218503040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832377.319727:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+23:17247:x1875726218503040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 272us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832377.319734:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788832377.320919:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07dde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218503040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788832377.321838:0:20381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788832377.321896:0:17247:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788832377.321916:0:17247:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788832377.321928:0:17247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b28353866f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538676 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832377.321939:0:17247:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c00031e00/0x998c12b28353866f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538676 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788832377.321949:0:17247:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788832377.321952:0:17247:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9d2b07d5b800 from 13 10000000:01000000:2.0:1788832377.321955:0:17247:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788832377.321988:0:17247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c01228200/0x998c12b28353867d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832377.321995:0:17247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff9d2c01228200/0x998c12b28353867d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832377.322004:0:17247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff9d2c01228200/0x998c12b28353867d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832377.322023:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc18700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218503168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788832377.322072:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832377.322106:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788832377.322122:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218503168 00000100:00100000:2.0:1788832377.322127:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218503168 00000100:00100000:2.0:1788832377.322165:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788832377.322173:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+23:17247:x1875726218503168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832377.322201:0:17245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832377.322213:0:17245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d2c01229600/0x998c12b283538684 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x998c12b28353867d expref: -99 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832377.322238:0:17245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d2c01229600/0x998c12b283538684 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x998c12b28353867d expref: 24 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832377.322247:0:17245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d2c01229600/0x998c12b283538684 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x998c12b28353867d expref: 24 pid: 17245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832377.322255:0:17245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c01229600, rc 0) 00000100:00100000:2.0:1788832377.322289:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:17247:x1875726218503168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832377.322296:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788832377.322331:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc18700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218503168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788832377.322343:0:17247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff9d2c01228200/0x998c12b28353867d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538684 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832377.322352:0:17247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff9d2c01228200/0x998c12b28353867d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x998c12b283538684 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832377.322399:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc18700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218503296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832377.322422:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832377.322447:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788832377.322757:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218503296 00000100:00100000:2.0:1788832377.322763:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218503296 00000100:00100000:2.0:1788832377.322785:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788832377.322792:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:17247:x1875726218503296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832377.322910:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:17247:x1875726218503296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832377.322916:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788832377.322947:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc18700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218503296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788832377.322973:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fc18700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218503424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832377.323011:0:17247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832377.323030:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788832377.323040:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218503424 00000100:00100000:2.0:1788832377.323044:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218503424 00000100:00100000:2.0:1788832377.323072:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788832377.323079:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:17247:x1875726218503424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788832377.323154:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:17247:x1875726218503424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832377.323161:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788832377.323345:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fc18700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e119a26-e2c8-49b5-8e81-f568246f48a1:17247:1875726218503424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788832377.324141:0:20382:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788832377.326077:0:17247:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788832377.326101:0:17247:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788832377.326112:0:17247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff9d2c01228200/0x998c12b28353867d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538684 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832377.326124:0:17247:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff9d2c01228200/0x998c12b28353867d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x998c12b283538684 expref: -99 pid: 17247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832377.753822:0:20282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788832378.270856:0:17287:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788832378.727897:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832378.728241:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202696320 00000100:00100000:2.0:1788832378.728251:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202696320 00000100:00100000:2.0:1788832378.728333:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:2.0:1788832378.728344:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:15596:x1875726202696320:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788832378.728382:0:17252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832378.728407:0:17252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b28353868b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b11 expref: -99 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728471:0:17252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283538692 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728498:0:17252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283538692 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728513:0:17252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283538692 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728529:0:17252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229c00/0x998c12b283538699 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728536:0:17252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229c00/0x998c12b283538699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728543:0:17252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229c00/0x998c12b283538699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728674:0:17252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b2835386a0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728682:0:17252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b2835386a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728689:0:17252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b2835386a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832378.728716:0:17252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788832378.728725:0:17252:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788832378.728762:0:17252:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b2835386a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728773:0:17252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283538692 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728780:0:17252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283538692 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728787:0:17252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283538692 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728793:0:17252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01228800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832378.728797:0:17252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283538692 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728805:0:17252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283538692 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728818:0:17252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2b073aec00) 00010000:00010000:2.0:1788832378.728821:0:17252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832378.728825:0:17252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283538692 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728830:0:17252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01228800/0x998c12b283538692 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728844:0:17252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229c00/0x998c12b283538699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728850:0:17252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229c00/0x998c12b283538699 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728867:0:17252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229c00/0x998c12b283538699 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728872:0:17252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c01229c00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832378.728875:0:17252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229c00/0x998c12b283538699 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728882:0:17252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229c00/0x998c12b283538699 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728890:0:17252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9d2c1b273000) 00010000:00010000:2.0:1788832378.728892:0:17252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832378.728895:0:17252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229c00/0x998c12b283538699 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728901:0:17252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229c00/0x998c12b283538699 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728934:0:17252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c01229a00/0x998c12b28353868b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b11 expref: 8 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728947:0:17252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffa00/0x998c12b2835386a0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b11 expref: 7 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.728954:0:17252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d2c1b273f00) 00010000:00010000:2.0:1788832378.728957:0:17252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788832378.728959:0:17252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cffa00, rc 0) 00000100:00100000:2.0:1788832378.729012:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+7:15596:x1875726202696320:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 670us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832378.729028:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00080000:3.0:1788832378.729304:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788832378.739651:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832378.739737:0:17262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202696448 00000100:00100000:2.0:1788832378.739746:0:17262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202696448 00000100:00100000:2.0:1788832378.739808:0:17262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:2.0:1788832378.739818:0:17262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+7:15596:x1875726202696448:12345-192.168.203.26@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788832378.739908:0:17262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+7:15596:x1875726202696448:12345-192.168.203.26@tcp:900:lhsmtool_posix.0 Request processed in 91us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832378.739915:0:17262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:0.0:1788832378.742205:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832378.742299:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202696704 00000100:00100000:2.0:1788832378.742313:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202696704 00000100:00100000:2.0:1788832378.742387:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:2.0:1788832378.742400:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+7:15596:x1875726202696704:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788832378.742421:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832378.742442:0:17253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835386a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b18 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.742531:0:17253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835386ae lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.742545:0:17253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835386ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.742571:0:17253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835386ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.742585:0:17253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b2835386b5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.742740:0:17253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b2835386b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.742748:0:17253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b2835386b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.742845:0:17253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe400/0x998c12b2835386bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.742982:0:17253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe400/0x998c12b2835386bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.742991:0:17253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe400/0x998c12b2835386bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832378.743003:0:17253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788832378.743149:0:17253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835386ae lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.743157:0:17253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835386ae lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.743164:0:17253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835386ae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.743170:0:17253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cffe00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832378.743175:0:17253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835386ae lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.743182:0:17253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835386ae lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.743204:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d2c1b273f00) 00010000:00010000:2.0:1788832378.743207:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832378.743212:0:17253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835386ae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.743218:0:17253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835386ae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.743232:0:17253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b2835386b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.743239:0:17253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b2835386b5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.743244:0:17253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b2835386b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.743250:0:17253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832378.743253:0:17253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b2835386b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.743258:0:17253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b2835386b5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.743266:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d2c1b273000) 00010000:00010000:2.0:1788832378.743268:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832378.743271:0:17253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b2835386b5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.743277:0:17253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b2835386b5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.747042:0:17253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b2835386a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b18 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.747070:0:17253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe400/0x998c12b2835386bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b18 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.747080:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d2c1b273800) 00010000:00010000:2.0:1788832378.747083:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832378.747086:0:17253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe400, rc 0) 00000100:00100000:2.0:1788832378.747156:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+9:15596:x1875726202696704:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 4758us (4965us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788832378.747165:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:1.0:1788832378.770510:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832378.771121:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202696832 00000100:00100000:2.0:1788832378.771138:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202696832 00000100:00100000:2.0:1788832378.771214:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:2.0:1788832378.771227:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+9:15596:x1875726202696832:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788832378.771358:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+9:15596:x1875726202696832:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 Request processed in 133us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832378.771366:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:1.0:1788832378.776554:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00010000:00010000:1.0:1788832378.776666:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788832378.776761:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202696960 00000100:00100000:3.0:1788832378.776781:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202696960 00000100:00100000:3.0:1788832378.776879:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:3.0:1788832378.776893:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:15596:x1875726202696960:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1788832378.777020:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1788832378.778435:0:17816:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1486us 00000100:00100000:0.0:1788832378.817786:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:15596:x1875726202696960:12345-192.168.203.26@tcp:59:lhsmtool_posix.0 Request processed in 40881us (41238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832378.817806:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:0.0:1788832378.836297:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832378.843178:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202697088 00000100:00100000:2.0:1788832378.843201:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202697088 00000100:00100000:3.0:1788832378.843406:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:3.0:1788832378.843419:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+9:15602:x1875726202697088:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788832378.843449:0:17252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832378.843482:0:17252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835386ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b1f expref: -99 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843569:0:17252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030a00/0x998c12b2835386d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843587:0:17252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030a00/0x998c12b2835386d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843601:0:17252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030a00/0x998c12b2835386d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843617:0:17252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835386d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843646:0:17252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835386d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843653:0:17252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835386d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843712:0:17252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030a00/0x998c12b2835386d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843737:0:17252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030a00/0x998c12b2835386d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843745:0:17252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030a00/0x998c12b2835386d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843752:0:17252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030a00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832378.843757:0:17252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030a00/0x998c12b2835386d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843765:0:17252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030a00/0x998c12b2835386d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843779:0:17252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2b073aec00) 00010000:00010000:3.0:1788832378.843782:0:17252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832378.843788:0:17252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030a00/0x998c12b2835386d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843794:0:17252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030a00/0x998c12b2835386d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843814:0:17252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835386d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843820:0:17252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835386d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843826:0:17252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835386d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843832:0:17252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832378.843842:0:17252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835386d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843849:0:17252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835386d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843857:0:17252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d2c1fe13300) 00010000:00010000:3.0:1788832378.843860:0:17252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832378.843863:0:17252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835386d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843870:0:17252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835386d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843909:0:17252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835386ca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b1f expref: 10 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843922:0:17252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2b073aec00) 00010000:00010000:3.0:1788832378.843924:0:17252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832378.843928:0:17252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835386ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b1f expref: 10 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.843940:0:17252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031000, rc 0) 00000100:00100000:3.0:1788832378.844037:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+9:15602:x1875726202697088:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 620us (7755us total) trans 0 rc 301/301 00000100:00100000:3.0:1788832378.844047:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:0.0:1788832378.852139:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832378.852260:0:17260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202697216 00000100:00100000:1.0:1788832378.852274:0:17260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202697216 00000100:00100000:1.0:1788832378.852345:0:17260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:1.0:1788832378.852358:0:17260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+9:15602:x1875726202697216:12345-192.168.203.26@tcp:700:lfs.0 00000100:00100000:1.0:1788832378.852471:0:17260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+9:15602:x1875726202697216:12345-192.168.203.26@tcp:700:lfs.0 Request processed in 116us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832378.852479:0:17260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:2.0:1788832378.855745:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832378.855835:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202697472 00000100:00100000:1.0:1788832378.855847:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202697472 00000100:00100000:1.0:1788832378.855921:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:1.0:1788832378.855933:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+9:15602:x1875726202697472:12345-192.168.203.26@tcp:36:lfs.0 00010000:00010000:1.0:1788832378.856010:0:17253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832378.856048:0:17253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050bc00/0x998c12b2835385f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04a8c expref: 9 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.856071:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2b073aec00) 00010000:00010000:1.0:1788832378.856077:0:17253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788832378.856157:0:17253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050ae00/0x998c12b2835386df lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.856173:0:17253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283538637 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04afc expref: 5 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.856183:0:17253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050ae00/0x998c12b2835386df lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.856238:0:17253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283538637 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04afc expref: 5 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.856280:0:17253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283538637 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04afc expref: 5 pid: 17253 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832378.856298:0:17253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c36d0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17253:1875726218503552:192.168.203.26@tcp:104: 00000100:00100000:1.0:1788832378.856415:0:17253:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c053ba000 going to sleep for 11 seconds 00000100:00100000:0.0:1788832378.864057:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832378.864198:0:17253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c36d0d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17253:1875726218503552:192.168.203.26@tcp:104: 00010000:00010000:1.0:1788832378.864246:0:17253:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050ae00/0x998c12b2835386df lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832378.864745:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202697600 00000100:00100000:2.0:1788832378.864754:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202697600 00010000:00010000:2.0:1788832378.864829:0:17238:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283538637 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04afc expref: 6 pid: 17253 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832378.864894:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00100000:2.0:1788832378.864906:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:2394:x1875726202697600:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832378.864938:0:17238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832378.864947:0:17238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283538637 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04afc expref: 6 pid: 17253 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.864962:0:17238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283538637 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04afc expref: 6 pid: 17253 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.864990:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c1fe0d200/0x998c12b283538637 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04afc expref: 6 pid: 17253 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.865007:0:17238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2b073aec00) 00010000:00010000:2.0:1788832378.865013:0:17238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050ae00/0x998c12b2835386df lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.865024:0:17238:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050ae00/0x998c12b2835386df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.865033:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050ae00/0x998c12b2835386df lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832378.865068:0:17238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832378.865135:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+5:2394:x1875726202697600:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 231us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832378.865144:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 15 00000100:00080000:3.0:1788832378.865588:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788832378.865673:0:17253:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050ae00/0x998c12b2835386df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.865685:0:17253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050ae00/0x998c12b2835386df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.865717:0:17253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050bc00/0x998c12b2835386e6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.865729:0:17253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050bc00/0x998c12b2835386e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.865738:0:17253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050bc00/0x998c12b2835386e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.873305:0:17253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835386ed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.873337:0:17253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835386ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.873366:0:17253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835386ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788832378.873390:0:17253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c079d95 reply state 00000000594593a7 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835386ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.873403:0:17253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835386ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.873412:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d2b073ae000) 00010000:00010000:1.0:1788832378.873415:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788832378.873420:0:17253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788832378.873428:0:17253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788832378.873438:0:17253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050ae00/0x998c12b2835386df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.873446:0:17253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050ae00/0x998c12b2835386df lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.873452:0:17253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050ae00/0x998c12b2835386df lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.873459:0:17253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c3050ae00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:1.0:1788832378.873465:0:17253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050ae00/0x998c12b2835386df lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.873473:0:17253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050ae00/0x998c12b2835386df lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.873484:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2b073aec00) 00010000:00010000:1.0:1788832378.873487:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788832378.873499:0:17253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050ae00/0x998c12b2835386df lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.873506:0:17253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050ae00/0x998c12b2835386df lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788832378.873530:0:17253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c079d95 reply state 00000000594593a7 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050bc00/0x998c12b2835386e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.873540:0:17253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050bc00/0x998c12b2835386e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832378.873559:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d2b073ae100) 00010000:00010000:1.0:1788832378.873561:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788832378.873564:0:17253:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788832378.875156:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+10:15602:x1875726202697472:12345-192.168.203.26@tcp:36:lfs.0 Request processed in 19201us (19400us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788832378.875171:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:0.0:1788832378.997789:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832378.997904:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202697728 00000100:00100000:3.0:1788832378.997916:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202697728 00000100:00100000:3.0:1788832378.998003:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:3.0:1788832378.998030:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+10:15610:x1875726202697728:12345-192.168.203.26@tcp:101:lctl.0 00010000:00010000:3.0:1788832378.998074:0:17252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832378.998105:0:17252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835386f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b26 expref: -99 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.998189:0:17252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835386fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.998206:0:17252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835386fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.998222:0:17252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835386fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832378.998506:0:17252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788832378.998512:0:17252:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788832378.998574:0:17252:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835386fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.998606:0:17252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835386f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b26 expref: 12 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.998663:0:17252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030600/0x998c12b2835386fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b26 expref: 11 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832378.998674:0:17252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c1fe13300) 00010000:00010000:3.0:1788832378.998677:0:17252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788832378.998681:0:17252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00030600, rc 0) 00000100:00100000:3.0:1788832378.998762:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+11:15610:x1875726202697728:12345-192.168.203.26@tcp:101:lctl.0 Request processed in 734us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832378.998782:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 29 00000100:00100000:0.0:1788832379.037036:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832379.037207:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202697856 00000100:00100000:3.0:1788832379.037219:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202697856 00000100:00100000:3.0:1788832379.037304:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:3.0:1788832379.037317:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+5:15611:x1875726202697856:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788832379.037345:0:17816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832379.037371:0:17816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283538702 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b2d expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.037465:0:17816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030a00/0x998c12b283538709 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.037483:0:17816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030a00/0x998c12b283538709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.037497:0:17816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030a00/0x998c12b283538709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832379.037559:0:17816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788832379.037564:0:17816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788832379.037594:0:17816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030a00/0x998c12b283538709 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.037663:0:17816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b283538702 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b2d expref: 7 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.037687:0:17816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030a00/0x998c12b283538709 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b2d expref: 6 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.037721:0:17816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c1fe13300) 00010000:00010000:3.0:1788832379.037724:0:17816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788832379.037728:0:17816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00030a00, rc 0) 00000100:00100000:3.0:1788832379.037799:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:15611:x1875726202697856:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 484us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832379.037807:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 30 00000100:00100000:2.0:1788832379.042495:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832379.042710:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202697984 00000100:00100000:3.0:1788832379.042724:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202697984 00000100:00100000:3.0:1788832379.042799:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:3.0:1788832379.042812:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:15611:x1875726202697984:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788832379.042842:0:17252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832379.042869:0:17252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538710 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b34 expref: -99 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.042953:0:17252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538717 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.042971:0:17252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538717 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.042985:0:17252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538717 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.042999:0:17252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353871e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043007:0:17252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353871e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043028:0:17252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353871e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043123:0:17252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283538725 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043131:0:17252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283538725 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043139:0:17252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283538725 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832379.043188:0:17252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788832379.043193:0:17252:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788832379.043217:0:17252:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283538725 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043231:0:17252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538717 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043237:0:17252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538717 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043244:0:17252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538717 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043250:0:17252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2c00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832379.043255:0:17252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538717 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043332:0:17252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538717 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043353:0:17252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c1fe13300) 00010000:00010000:3.0:1788832379.043356:0:17252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832379.043361:0:17252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538717 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043369:0:17252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538717 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043385:0:17252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353871e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043391:0:17252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353871e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043398:0:17252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353871e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043403:0:17252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d3000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832379.043407:0:17252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353871e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043412:0:17252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353871e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043479:0:17252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d2b073ae100) 00010000:00010000:3.0:1788832379.043482:0:17252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832379.043485:0:17252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353871e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043491:0:17252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353871e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043532:0:17252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538710 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b34 expref: 8 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043562:0:17252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283538725 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b34 expref: 7 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.043571:0:17252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d2b073ae000) 00010000:00010000:3.0:1788832379.043573:0:17252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788832379.043576:0:17252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2400, rc 0) 00000100:00100000:3.0:1788832379.043933:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+7:15611:x1875726202697984:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1120us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832379.043942:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 31 00000100:00100000:0.0:1788832379.056760:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832379.057081:0:17262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202698112 00000100:00100000:2.0:1788832379.057094:0:17262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202698112 00000100:00100000:2.0:1788832379.057177:0:17262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:2.0:1788832379.057189:0:17262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07f34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+5:15611:x1875726202698112:12345-192.168.203.26@tcp:900:lfs.0 00000100:00100000:2.0:1788832379.057304:0:17262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07f34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+5:15611:x1875726202698112:12345-192.168.203.26@tcp:900:lfs.0 Request processed in 116us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832379.057313:0:17262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00080000:3.0:1788832379.058253:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788832379.063057:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832379.063237:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202698368 00000100:00100000:1.0:1788832379.063251:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202698368 00000100:00100000:1.0:1788832379.063436:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 32 00000100:00100000:1.0:1788832379.063450:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+7:15611:x1875726202698368:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1788832379.063478:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788832379.063505:0:17253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050ae00/0x998c12b28353872c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b3b expref: -99 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788832379.063676:0:17253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788832379.063808:0:17253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050ae00/0x998c12b28353872c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b3b expref: 9 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832379.063848:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c1fe13300) 00010000:00010000:1.0:1788832379.063851:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788832379.063856:0:17253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050ae00/0x998c12b28353872c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b3b expref: 9 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832379.063872:0:17253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c3050ae00, rc 0) 00000100:00100000:1.0:1788832379.063963:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+8:15611:x1875726202698368:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 516us (920us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788832379.063971:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 32 00000100:00100000:2.0:1788832379.067394:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832379.067655:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202698624 00000100:00100000:3.0:1788832379.067669:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202698624 00000100:00100000:3.0:1788832379.067731:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:3.0:1788832379.067742:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+8:15611:x1875726202698624:12345-192.168.203.26@tcp:36:lfs.0 00010000:00010000:3.0:1788832379.067814:0:17251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832379.067845:0:17251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283538725 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b34 expref: 8 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.067869:0:17251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d2b073ae000) 00010000:00010000:3.0:1788832379.067874:0:17251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788832379.067898:0:17251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353873a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.067969:0:17251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353873a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.067999:0:17251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353873a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788832379.068519:0:17251:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d3e836b reply state 00000000ee28f6a5 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353873a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.068536:0:17251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353873a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.068543:0:17251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d2b073ae000) 00010000:00010000:3.0:1788832379.068558:0:17251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1788832379.068561:0:17251:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788832379.068571:0:17251:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788832379.068926:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+9:15611:x1875726202698624:12345-192.168.203.26@tcp:36:lfs.0 Request processed in 1174us (1534us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788832379.068937:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 33 00000100:00100000:2.0:1788832379.071854:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832379.072018:0:17254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202698880 00000100:00100000:1.0:1788832379.072031:0:17254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202698880 00000100:00100000:1.0:1788832379.072101:0:17254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:1.0:1788832379.072113:0:17254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+9:15611:x1875726202698880:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1788832379.072524:0:17254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+10:15611:x1875726202698880:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 410us (681us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788832379.072533:0:17254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:1.0:1788832379.076272:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832379.076365:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202699136 00000100:00100000:3.0:1788832379.076379:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202699136 00000100:00100000:3.0:1788832379.076498:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:3.0:1788832379.076512:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+10:15611:x1875726202699136:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788832379.076558:0:17816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832379.076583:0:17816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538741 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b42 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.076707:0:17816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538748 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.076725:0:17816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538748 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.076740:0:17816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538748 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.076779:0:17816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b28353874f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.076786:0:17816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b28353874f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.076792:0:17816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b28353874f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832379.076994:0:17816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788832379.077087:0:17816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538748 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.077095:0:17816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538748 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.077102:0:17816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538748 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.077108:0:17816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030c00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832379.077114:0:17816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538748 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.077122:0:17816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538748 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.077136:0:17816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c1fe13300) 00010000:00010000:3.0:1788832379.077139:0:17816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832379.077145:0:17816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538748 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.077174:0:17816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538748 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.077192:0:17816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b28353874f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.077198:0:17816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b28353874f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.077204:0:17816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b28353874f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.077209:0:17816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00031000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832379.077211:0:17816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b28353874f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.077218:0:17816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b28353874f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.077225:0:17816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d2b073ae100) 00010000:00010000:3.0:1788832379.077228:0:17816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832379.077231:0:17816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b28353874f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.077236:0:17816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b28353874f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.077276:0:17816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538741 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b42 expref: 12 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.077300:0:17816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c1fe13300) 00010000:00010000:3.0:1788832379.077302:0:17816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788832379.077306:0:17816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538741 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b42 expref: 12 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.077318:0:17816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2c00, rc 0) 00000100:00100000:3.0:1788832379.077466:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+11:15611:x1875726202699136:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 957us (1209us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788832379.077476:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 34 00000100:00100000:1.0:1788832379.081522:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832379.081754:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202699264 00000100:00100000:2.0:1788832379.081767:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202699264 00000100:00100000:2.0:1788832379.081848:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:2.0:1788832379.081860:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+11:15611:x1875726202699264:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1788832379.081895:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832379.082008:0:17253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b28353875d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b49 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.082152:0:17253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283538764 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.082177:0:17253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283538764 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.082192:0:17253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283538764 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832379.082248:0:17253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788832379.082253:0:17253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788832379.082291:0:17253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283538764 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.082324:0:17253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b28353875d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b49 expref: 13 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.082346:0:17253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283538764 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b49 expref: 12 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.082356:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d2b073ae000) 00010000:00010000:2.0:1788832379.082360:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788832379.082364:0:17253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfec00, rc 0) 00000100:00100000:2.0:1788832379.082493:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+12:15611:x1875726202699264:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 635us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832379.082502:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 35 00000100:00100000:2.0:1788832379.086362:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832379.086447:0:17254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202699392 00000100:00100000:0.0:1788832379.086461:0:17254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202699392 00000100:00100000:0.0:1788832379.086534:0:17254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:0.0:1788832379.086568:0:17254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+12:15611:x1875726202699392:12345-192.168.203.26@tcp:37:lfs.0 00000100:00100000:2.0:1788832379.093885:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832379.093933:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832379.093959:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832379.093983:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832379.094004:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832379.094030:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832379.094062:0:18758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202699776 00000100:00100000:2.0:1788832379.094074:0:18758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202699776 00000100:00100000:2.0:1788832379.094137:0:18758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202700032 00000100:00100000:2.0:1788832379.094155:0:18758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202700032 00000100:00100000:2.0:1788832379.094178:0:18758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202699904 00000100:00100000:2.0:1788832379.094181:0:18758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202699904 00000100:00100000:2.0:1788832379.094195:0:18758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202700160 00000100:00100000:2.0:1788832379.094197:0:18758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202700160 00000100:00100000:2.0:1788832379.094215:0:18758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:2.0:1788832379.094227:0:18758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:2393:x1875726202699776:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832379.094381:0:19717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:0.0:1788832379.094393:0:19717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+5:2393:x1875726202700032:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832379.094467:0:19717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+5:2393:x1875726202700032:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 77us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832379.094476:0:19717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:0.0:1788832379.094506:0:19717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:0.0:1788832379.094512:0:19717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:2393:x1875726202699904:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832379.094539:0:19717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:2393:x1875726202699904:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 27us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832379.094557:0:19717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:0.0:1788832379.094568:0:19717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:0.0:1788832379.094576:0:19717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+5:2393:x1875726202700160:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832379.094601:0:19717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+5:2393:x1875726202700160:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 25us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832379.094606:0:19717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:0.0:1788832379.094645:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202699648 00000100:00100000:0.0:1788832379.094650:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202699648 00000100:00100000:0.0:1788832379.094680:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:0.0:1788832379.094687:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:2393:x1875726202699648:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832379.094717:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:2393:x1875726202699648:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 30us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832379.094723:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:1.0:1788832379.095164:0:17254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+12:15611:x1875726202699392:12345-192.168.203.26@tcp:37:lfs.0 Request processed in 8599us (8815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832379.095174:0:17254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 3 00000100:00100000:3.0:1788832379.095462:0:17245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202699520 00000100:00100000:3.0:1788832379.095468:0:17245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202699520 00000100:00100000:3.0:1788832379.095517:0:17245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 165 00000100:00100000:3.0:1788832379.095526:0:17245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:2393:x1875726202699520:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832379.095578:0:17245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:2393:x1875726202699520:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 54us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832379.095585:0:17245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 165 00000100:00080000:3.0:1788832379.095656:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788832379.095662:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788832379.095880:0:18758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:2393:x1875726202699776:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 1653us (1944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832379.095889:0:18758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:2.0:1788832379.100127:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832379.100353:0:17255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202700416 00000100:00100000:1.0:1788832379.100365:0:17255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202700416 00000100:00100000:1.0:1788832379.100486:0:17255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:1.0:1788832379.100499:0:17255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0768a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+12:15611:x1875726202700416:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:1.0:1788832379.100858:0:17255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0768a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+13:15611:x1875726202700416:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 360us (743us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788832379.100867:0:17255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 4 00000100:00100000:1.0:1788832379.165968:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832379.166060:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202700544 00000100:00100000:3.0:1788832379.166073:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202700544 00000100:00100000:3.0:1788832379.166152:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:3.0:1788832379.166171:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+11:15617:x1875726202700544:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788832379.166196:0:17251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832379.166221:0:17251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b28353876b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b50 expref: -99 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166329:0:17251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538772 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166345:0:17251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538772 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166356:0:17251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538772 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166369:0:17251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538779 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166377:0:17251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538779 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166383:0:17251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538779 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166478:0:17251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283538780 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166487:0:17251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283538780 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166493:0:17251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283538780 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832379.166533:0:17251:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788832379.166538:0:17251:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788832379.166592:0:17251:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283538780 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166617:0:17251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538772 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166673:0:17251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538772 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166681:0:17251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538772 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166688:0:17251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c00030c00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832379.166693:0:17251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538772 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166702:0:17251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538772 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166717:0:17251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c1fe13300) 00010000:00010000:3.0:1788832379.166720:0:17251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832379.166725:0:17251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538772 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166731:0:17251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b283538772 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166748:0:17251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538779 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166755:0:17251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538779 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166761:0:17251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538779 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166773:0:17251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d2c00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832379.166776:0:17251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538779 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166782:0:17251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538779 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166791:0:17251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d2b073ae100) 00010000:00010000:3.0:1788832379.166794:0:17251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832379.166797:0:17251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538779 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166803:0:17251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b283538779 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166832:0:17251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b28353876b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b50 expref: 13 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166846:0:17251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2400/0x998c12b283538780 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b50 expref: 12 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.166854:0:17251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d2b073ae000) 00010000:00010000:3.0:1788832379.166856:0:17251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788832379.166859:0:17251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2400, rc 0) 00000100:00100000:3.0:1788832379.166942:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+12:15617:x1875726202700544:12345-192.168.203.26@tcp:101:bash.0 Request processed in 781us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832379.166950:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 36 00000100:00100000:2.0:1788832379.171566:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832379.171777:0:17262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202700672 00000100:00100000:3.0:1788832379.171809:0:17262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202700672 00000100:00100000:3.0:1788832379.171884:0:17262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:3.0:1788832379.171897:0:17262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:15617:x1875726202700672:12345-192.168.203.26@tcp:900:bash.0 00000100:00100000:3.0:1788832379.171998:0:17262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:15617:x1875726202700672:12345-192.168.203.26@tcp:900:bash.0 Request processed in 102us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832379.172006:0:17262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:0.0:1788832379.175409:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832379.175515:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202700928 00000100:00100000:2.0:1788832379.175527:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202700928 00000100:00100000:2.0:1788832379.175616:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 37 00000100:00100000:2.0:1788832379.175660:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+12:15617:x1875726202700928:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:2.0:1788832379.175689:0:17252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832379.175717:0:17252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b283538787 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b57 expref: -99 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.175863:0:17252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b28353878e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.175881:0:17252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283538764 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b49 expref: 12 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.175891:0:17252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b28353878e lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.175957:0:17252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283538764 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b49 expref: 12 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.175974:0:17252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283538764 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b49 expref: 12 pid: 17253 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832379.175990:0:17252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17252:1875726218503680:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788832379.176095:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788832379.180274:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832379.180428:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202701056 00000100:00100000:1.0:1788832379.180439:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202701056 00010000:00010000:1.0:1788832379.180494:0:17236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283538764 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b49 expref: 13 pid: 17253 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832379.180554:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 16 00000100:00100000:1.0:1788832379.180566:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+13:2394:x1875726202701056:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832379.180585:0:17236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832379.180593:0:17236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283538764 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b49 expref: 13 pid: 17253 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832379.180609:0:17236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283538764 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b49 expref: 13 pid: 17253 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832379.180683:0:17236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d2b073ae000) 00010000:00010000:1.0:1788832379.180691:0:17236:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b28353878e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832379.180703:0:17236:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b28353878e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832379.180713:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b28353878e lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832379.180758:0:17236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832379.180821:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+13:2394:x1875726202701056:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 256us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832379.180829:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 16 00010000:00010000:2.0:1788832379.181466:0:17252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b283538764 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b49 expref: 12 pid: 17253 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832379.181490:0:17252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17252:1875726218503680:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832379.181518:0:17252:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b28353878e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.181528:0:17252:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b28353878e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.181535:0:17252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b28353878e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.181573:0:17252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283538795 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.181585:0:17252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283538795 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.181595:0:17252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283538795 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.182244:0:17252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353879c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.182267:0:17252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353879c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.182276:0:17252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353879c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832379.182288:0:17252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788832379.182322:0:17252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b28353878e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.182330:0:17252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b28353878e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.182336:0:17252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b28353878e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.182342:0:17252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cff200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832379.182347:0:17252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b28353878e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.182355:0:17252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b28353878e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.182367:0:17252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d2b073ae000) 00010000:00010000:2.0:1788832379.182371:0:17252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832379.182375:0:17252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b28353878e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.182395:0:17252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b28353878e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788832379.182410:0:17252:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048158697 reply state 00000000ec70fb77 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283538795 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.182423:0:17252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283538795 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.182429:0:17252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9d2c1b273000) 00010000:00010000:2.0:1788832379.182432:0:17252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788832379.182434:0:17252:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788832379.182480:0:17252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b283538787 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b57 expref: 15 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.182497:0:17252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353879c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b57 expref: 14 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.182505:0:17252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:2.0:1788832379.182507:0:17252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788832379.182510:0:17252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cff800, rc 0) 00000100:00100000:2.0:1788832379.182596:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+15:15617:x1875726202700928:12345-192.168.203.26@tcp:101:bash.0 Request processed in 6939us (7200us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788832379.182605:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 37 00000100:00100000:0.0:1788832379.195745:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832379.195843:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202701184 00000100:00100000:3.0:1788832379.195855:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202701184 00000100:00100000:3.0:1788832379.195932:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:3.0:1788832379.195949:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+15:15617:x1875726202701184:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:3.0:1788832379.195981:0:17251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832379.196008:0:17251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b2835387aa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b5e expref: -99 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.196090:0:17251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835387b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.196106:0:17251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835387b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.196120:0:17251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835387b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832379.196201:0:17251:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788832379.196206:0:17251:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788832379.196229:0:17251:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835387b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.196242:0:17251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835387b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.196309:0:17251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b2835387aa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b5e expref: 17 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.196329:0:17251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835387b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b5e expref: 16 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.196338:0:17251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:3.0:1788832379.196341:0:17251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788832379.196345:0:17251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00031000, rc 0) 00000100:00100000:3.0:1788832379.196421:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+16:15617:x1875726202701184:12345-192.168.203.26@tcp:101:bash.0 Request processed in 474us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832379.196428:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 38 00000100:00100000:1.0:1788832379.199649:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832379.199771:0:17254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202701440 00000100:00100000:0.0:1788832379.199783:0:17254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202701440 00000100:00100000:0.0:1788832379.199848:0:17254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:0.0:1788832379.199858:0:17254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+16:15617:x1875726202701440:12345-192.168.203.26@tcp:35:bash.0 00000100:00100000:0.0:1788832379.200236:0:17254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+17:15617:x1875726202701440:12345-192.168.203.26@tcp:35:bash.0 Request processed in 377us (628us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788832379.200267:0:17254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 5 00000100:00100000:0.0:1788832379.283490:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832379.283863:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202701696 00000100:00100000:3.0:1788832379.283877:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202701696 00000100:00100000:3.0:1788832379.283960:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 39 00000100:00100000:3.0:1788832379.283973:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+17:15627:x1875726202701696:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788832379.284006:0:17816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832379.284032:0:17816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835387b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b65 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832379.284182:0:17816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788832379.284327:0:17816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835387b8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b65 expref: 19 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.284344:0:17816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d2c1fe13300) 00010000:00010000:3.0:1788832379.284347:0:17816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788832379.284369:0:17816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835387b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b65 expref: 19 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.284398:0:17816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c00030c00, rc 0) 00000100:00100000:3.0:1788832379.284482:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+18:15627:x1875726202701696:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 511us (1006us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788832379.284490:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 39 00000040:00080000:0.0:1788832379.287584:0:17287:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788832379.295925:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832379.296070:0:17254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202701952 00000100:00100000:0.0:1788832379.296086:0:17254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202701952 00000100:00100000:0.0:1788832379.296163:0:17254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:0.0:1788832379.296175:0:17254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+18:15627:x1875726202701952:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:0.0:1788832379.296405:0:17254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+19:15627:x1875726202701952:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 232us (494us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788832379.296414:0:17254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 6 00000100:00100000:1.0:1788832379.340342:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832379.340454:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202702208 00000100:00100000:3.0:1788832379.340463:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202702208 00000100:00100000:3.0:1788832379.340534:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:3.0:1788832379.340554:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+19:15630:x1875726202702208:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1788832379.340585:0:17251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832379.340608:0:17251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835387c6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b6c expref: -99 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.340770:0:17251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b2835387cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.340786:0:17251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b2835387cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.340797:0:17251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b2835387cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832379.340808:0:17251:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788832379.340914:0:17251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00030c00/0x998c12b2835387c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b6c expref: 22 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.340935:0:17251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b2835387cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b6c expref: 21 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.340959:0:17251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:3.0:1788832379.340961:0:17251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788832379.340965:0:17251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c421d2c00, rc 0) 00000100:00100000:3.0:1788832379.341034:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+21:15630:x1875726202702208:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 491us (700us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788832379.341041:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 40 00000100:00100000:1.0:1788832379.347300:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832379.347346:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832379.347436:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202702336 00000100:00100000:0.0:1788832379.347446:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202702336 00000100:00100000:0.0:1788832379.347513:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:0.0:1788832379.347525:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+21:2394:x1875726202702336:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832379.347541:0:17237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832379.347576:0:17237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d2c00/0x998c12b2835387cd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b6c expref: 21 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832379.347596:0:17237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:0.0:1788832379.347600:0:17237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832379.347691:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+20:2394:x1875726202702336:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 168us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832379.347700:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:3.0:1788832379.348038:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202702464 00000100:00100000:3.0:1788832379.348044:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202702464 00000100:00100000:3.0:1788832379.348080:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:3.0:1788832379.348087:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+20:15630:x1875726202702464:12345-192.168.203.26@tcp:54:lfs.0 00010000:00010000:3.0:1788832379.348145:0:17816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.348161:0:17816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.348171:0:17816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.348205:0:17816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.348211:0:17816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387db lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.348218:0:17816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.348223:0:17816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c4204a200 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832379.348241:0:17816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.348248:0:17816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387db lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.348257:0:17816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:3.0:1788832379.348260:0:17816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788832379.348264:0:17816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387db lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.348270:0:17816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832379.348320:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+20:15630:x1875726202702464:12345-192.168.203.26@tcp:54:lfs.0 Request processed in 234us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832379.348328:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 41 00000100:00100000:1.0:1788832379.355203:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832379.355304:0:17255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202702720 00000100:00100000:2.0:1788832379.355315:0:17255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202702720 00000100:00100000:2.0:1788832379.355379:0:17255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 7 00000100:00100000:2.0:1788832379.355408:0:17255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+20:15630:x1875726202702720:12345-192.168.203.26@tcp:35:lfs.0 00000100:00100000:2.0:1788832379.355666:0:17255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+21:15630:x1875726202702720:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 260us (471us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788832379.355674:0:17255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 7 00000040:00080000:1.0:1788832379.607452:0:18007:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788832379.680442:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832379.680532:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202702976 00000100:00100000:3.0:1788832379.680550:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202702976 00000100:00100000:3.0:1788832379.680615:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:3.0:1788832379.680661:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+21:15661:x1875726202702976:12345-192.168.203.26@tcp:101:cat.0 00010000:00010000:3.0:1788832379.680688:0:17251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832379.680710:0:17251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387e2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b73 expref: -99 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.680821:0:17251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b600/0x998c12b2835387e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.680835:0:17251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b600/0x998c12b2835387e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.680866:0:17251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b600/0x998c12b2835387e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832379.680879:0:17251:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788832379.680998:0:17251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387e2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b73 expref: 24 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.681017:0:17251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b600/0x998c12b2835387e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b73 expref: 23 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.681026:0:17251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:3.0:1788832379.681029:0:17251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788832379.681033:0:17251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c4204b600, rc 0) 00000100:00100000:3.0:1788832379.681096:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+23:15661:x1875726202702976:12345-192.168.203.26@tcp:101:cat.0 Request processed in 438us (663us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788832379.681104:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 42 00000100:00100000:1.0:1788832379.687960:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832379.688056:0:17255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202703232 00000100:00100000:2.0:1788832379.688065:0:17255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202703232 00000100:00100000:2.0:1788832379.688112:0:17255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:2.0:1788832379.688122:0:17255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+23:15661:x1875726202703232:12345-192.168.203.26@tcp:35:cat.0 00000100:00100000:1.0:1788832379.688398:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832379.688499:0:17255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+24:15661:x1875726202703232:12345-192.168.203.26@tcp:35:cat.0 Request processed in 377us (547us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788832379.688507:0:17255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 8 00000100:00100000:3.0:1788832379.688600:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202703360 00000100:00100000:3.0:1788832379.688606:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202703360 00000100:00100000:3.0:1788832379.688681:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:3.0:1788832379.688690:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+24:2393:x1875726202703360:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832379.688701:0:17238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832379.688724:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b600/0x998c12b2835387e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b73 expref: 24 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.688742:0:17238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:3.0:1788832379.688747:0:17238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832379.692479:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+23:2393:x1875726202703360:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 3778us (4071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832379.692494:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:2.0:1788832379.750752:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832379.750870:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202703616 00000100:00100000:3.0:1788832379.750880:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202703616 00000100:00100000:3.0:1788832379.750954:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:3.0:1788832379.750965:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+23:15667:x1875726202703616:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:3.0:1788832379.750989:0:17816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832379.751012:0:17816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b600/0x998c12b2835387f7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b7a expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.751428:0:17816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387fe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.751445:0:17816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353879c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b57 expref: 24 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.751453:0:17816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835387b1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b5e expref: 24 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.751461:0:17816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387fe lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.751495:0:17816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835387b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b5e expref: 24 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.751508:0:17816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835387b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b5e expref: 24 pid: 17251 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832379.751552:0:17816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ddc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17816:1875726218503808:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788832379.751669:0:17816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353879c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b57 expref: 24 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.751679:0:17816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353879c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b57 expref: 24 pid: 17252 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832379.751688:0:17816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ddce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17816:1875726218503936:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788832379.751712:0:17816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c0927f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788832379.756006:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832379.756051:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832379.756150:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202703744 00000100:00100000:2.0:1788832379.756171:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202703744 00010000:00010000:2.0:1788832379.756216:0:17237:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835387b1 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b5e expref: 25 pid: 17251 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832379.756471:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202703872 00000100:00100000:2.0:1788832379.756476:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202703872 00010000:00010000:2.0:1788832379.756491:0:17237:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353879c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b57 expref: 26 pid: 17252 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832379.756608:0:17816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ddc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17816:1875726218503808:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788832379.756657:0:17816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ddce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:17816:1875726218503936:192.168.203.26@tcp:104: 00010000:00010000:3.0:1788832379.756680:0:17816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387fe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832379.756749:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:1.0:1788832379.756760:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+26:2394:x1875726202703744:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832379.756773:0:17238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832379.756780:0:17238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835387b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b5e expref: 26 pid: 17251 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832379.756792:0:17238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835387b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b5e expref: 26 pid: 17251 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832379.756814:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c00031000/0x998c12b2835387b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b5e expref: 26 pid: 17251 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832379.756851:0:17238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:1.0:1788832379.756855:0:17238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387fe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832379.756863:0:17238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387fe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832379.756869:0:17238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832379.756959:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+25:2394:x1875726202703744:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 200us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832379.756966:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 17 00000100:00100000:1.0:1788832379.756985:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 18 00000100:00100000:1.0:1788832379.756993:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+24:2394:x1875726202703872:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788832379.757001:0:17238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788832379.757006:0:17238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353879c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b57 expref: 24 pid: 17252 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832379.757016:0:17238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353879c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b57 expref: 24 pid: 17252 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832379.757030:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353879c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b57 expref: 24 pid: 17252 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832379.757041:0:17238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:1.0:1788832379.757044:0:17238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387fe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832379.757062:0:17238:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832379.757068:0:17238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387fe lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832379.757089:0:17238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788832379.757109:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+23:2394:x1875726202703872:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 118us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832379.757116:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 18 00010000:00010000:2.0:1788832379.757423:0:17816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.757431:0:17816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387fe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832379.757460:0:17816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788832379.757617:0:17816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b600/0x998c12b2835387f7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b7a expref: 24 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.757657:0:17816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a200/0x998c12b2835387fe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b7a expref: 23 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.757664:0:17816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:2.0:1788832379.757666:0:17816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788832379.757669:0:17816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c4204a200, rc 0) 00000100:00100000:2.0:1788832379.757697:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+23:15667:x1875726202703616:12345-192.168.203.26@tcp:101:dd.0 Request processed in 6735us (6956us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788832379.757705:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 43 00000100:00100000:1.0:1788832379.760215:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832379.760332:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202704000 00000100:00100000:3.0:1788832379.760341:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202704000 00000100:00100000:3.0:1788832379.760432:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:3.0:1788832379.760442:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+23:15667:x1875726202704000:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:3.0:1788832379.760464:0:17251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832379.760487:0:17251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204aa00/0x998c12b28353880c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b81 expref: -99 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.760518:0:17251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b400/0x998c12b283538813 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.760560:0:17251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b400/0x998c12b283538813 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.760572:0:17251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b400/0x998c12b283538813 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.760704:0:17251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204aa00/0x998c12b28353880c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b81 expref: 25 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.760716:0:17251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b400/0x998c12b283538813 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b81 expref: 24 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.760722:0:17251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:3.0:1788832379.760724:0:17251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788832379.760726:0:17251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c4204b400, rc 0) 00000100:00100000:3.0:1788832379.760768:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+24:15667:x1875726202704000:12345-192.168.203.26@tcp:101:dd.0 Request processed in 329us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832379.760772:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 44 00000100:00100000:3.0:1788832379.762887:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832379.763244:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202704256 00000100:00100000:2.0:1788832379.763253:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202704256 00000100:00100000:2.0:1788832379.763395:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 45 00000100:00100000:2.0:1788832379.763406:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+24:15667:x1875726202704256:12345-192.168.203.26@tcp:36:dd.0 00010000:00010000:2.0:1788832379.763656:0:17252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b28353881a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.763671:0:17252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b28353881a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.763682:0:17252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b28353881a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788832379.763721:0:17252:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788832379.763756:0:17252:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f47d4673 reply state 00000000953e7430 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b28353881a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.763769:0:17252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b28353881a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.763776:0:17252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:2.0:1788832379.763778:0:17252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788832379.763781:0:17252:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788832379.763858:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+27:15667:x1875726202704256:12345-192.168.203.26@tcp:36:dd.0 Request processed in 452us (1238us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788832379.763864:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 45 00000020:00080000:2.0:1788832379.763868:0:17252:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788832379.765501:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832379.765582:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202704384 00000100:00100000:2.0:1788832379.765590:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202704384 00000100:00100000:2.0:1788832379.765656:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:2.0:1788832379.765665:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+27:15667:x1875726202704384:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:2.0:1788832379.765684:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832379.765706:0:17253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283538821 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b88 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.765753:0:17253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283538821 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b88 expref: 28 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.765767:0:17253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283538821 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b88 expref: 28 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.765788:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:2.0:1788832379.765791:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788832379.765806:0:17253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe000, rc 0) 00000100:00100000:2.0:1788832379.765858:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+28:15667:x1875726202704384:12345-192.168.203.26@tcp:101:dd.0 Request processed in 193us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832379.765865:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 46 00000100:00100000:1.0:1788832379.774929:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832379.775556:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202704640 00000100:00100000:2.0:1788832379.775566:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202704640 00000100:00100000:2.0:1788832379.775672:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:2.0:1788832379.775683:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+28:15667:x1875726202704640:12345-192.168.203.26@tcp:103:dd.0 00010000:00010000:2.0:1788832379.775722:0:17237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832379.775749:0:17237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283538821 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b88 expref: 28 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.775769:0:17237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:2.0:1788832379.775774:0:17237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788832379.775830:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+27:15667:x1875726202704640:12345-192.168.203.26@tcp:103:dd.0 Request processed in 149us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832379.775838:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 2 00000100:00100000:0.0:1788832379.777901:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832379.777987:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202704768 00000100:00100000:3.0:1788832379.777995:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202704768 00000100:00100000:3.0:1788832379.778050:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:3.0:1788832379.778059:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+27:15667:x1875726202704768:12345-192.168.203.26@tcp:58:dd.0 00010000:00010000:3.0:1788832379.778172:0:17816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a800/0x998c12b283538828 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.778189:0:17816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a800/0x998c12b283538828 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832379.778208:0:17816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a800/0x998c12b283538828 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788832379.779363:0:17816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788832379.779391:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788832379.779527:0:17816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788832379.779797:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+27:15667:x1875726202704768:12345-192.168.203.26@tcp:58:dd.0 Request processed in 1736us (1900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832379.779807:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 47 00000100:00100000:3.0:1788832379.782465:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832379.783766:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202704896 00000100:00100000:2.0:1788832379.783778:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202704896 00000100:00100000:2.0:1788832379.783896:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 48 00000100:00100000:2.0:1788832379.783906:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+27:15667:x1875726202704896:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:2.0:1788832379.783927:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832379.783948:0:17253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353882f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b8f expref: -99 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.784002:0:17253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a800/0x998c12b283538828 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.784029:0:17253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353882f lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b8f expref: 28 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.784049:0:17253:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a800/0x998c12b283538828 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.784064:0:17253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353882f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b8f expref: 28 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.784079:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:2.0:1788832379.784082:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788832379.784086:0:17253:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353882f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b8f expref: 28 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832379.784094:0:17253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cff800, rc 0) 00000100:00100000:2.0:1788832379.784178:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+28:15667:x1875726202704896:12345-192.168.203.26@tcp:101:dd.0 Request processed in 273us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832379.784185:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 48 00010000:00010000:0.0:1788832379.799661:0:19721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832380.120512:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788832380.120550:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c04dc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218504064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788832380.120649:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832380.121090:0:18761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218504064 00000100:00100000:3.0:1788832380.121098:0:18761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218504064 00000100:00100000:3.0:1788832380.121180:0:18761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788832380.121191:0:18761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218504064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788832380.121237:0:18761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788832380.121303:0:18761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1875726218504064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832380.121310:0:18761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788832380.121452:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c04dc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1875726218504064:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788832380.121785:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788832380.311189:0:17287:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788832380.311199:0:17287:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788832380.311234:0:17287:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788832380.311245:0:17287:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788832380.311386:0:17287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c04dc4380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17287:1875726218504192:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788832380.311487:0:17287:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b067739c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832380.317239:0:17287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c04dc4380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17287:1875726218504192:192.168.203.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788832380.328109:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832380.328504:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202705024 00000100:00100000:2.0:1788832380.328514:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202705024 00000100:00100000:2.0:1788832380.328600:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00100000:2.0:1788832380.328613:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+28:15668:x1875726202705024:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788832380.328692:0:17252:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788832380.328850:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+28:15668:x1875726202705024:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 239us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832380.328868:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 49 00000100:00080000:0.0:1788832380.329527:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788832380.341075:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832380.341191:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202705152 00000100:00100000:0.0:1788832380.341201:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202705152 00000100:00100000:0.0:1788832380.341261:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:0.0:1788832380.341271:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+28:15668:x1875726202705152:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788832380.341344:0:17251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dcc00/0x998c12b283538836 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341362:0:17251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dcc00/0x998c12b283538836 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341377:0:17251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dcc00/0x998c12b283538836 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341402:0:17251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc800/0x998c12b28353883d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341411:0:17251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc800/0x998c12b28353883d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341418:0:17251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc800/0x998c12b28353883d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341455:0:17251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd400/0x998c12b283538844 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341465:0:17251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd400/0x998c12b283538844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341473:0:17251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd400/0x998c12b283538844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788832380.341516:0:17251:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788832380.341521:0:17251:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788832380.341544:0:17251:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd400/0x998c12b283538844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341555:0:17251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dcc00/0x998c12b283538836 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341561:0:17251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dcc00/0x998c12b283538836 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341567:0:17251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dcc00/0x998c12b283538836 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341572:0:17251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dcc00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832380.341576:0:17251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dcc00/0x998c12b283538836 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341585:0:17251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dcc00/0x998c12b283538836 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341597:0:17251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d2c1b273800) 00010000:00010000:0.0:1788832380.341607:0:17251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832380.341612:0:17251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dcc00/0x998c12b283538836 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341646:0:17251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dcc00/0x998c12b283538836 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341662:0:17251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc800/0x998c12b28353883d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341668:0:17251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc800/0x998c12b28353883d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341673:0:17251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc800/0x998c12b28353883d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341678:0:17251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dc800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832380.341681:0:17251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc800/0x998c12b28353883d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341687:0:17251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc800/0x998c12b28353883d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341695:0:17251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9d2c0f9a5200) 00010000:00010000:0.0:1788832380.341698:0:17251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832380.341701:0:17251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc800/0x998c12b28353883d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341706:0:17251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dc800/0x998c12b28353883d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341722:0:17251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd400/0x998c12b283538844 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341734:0:17251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd400/0x998c12b283538844 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341739:0:17251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd400/0x998c12b283538844 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341744:0:17251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c092dd400 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832380.341747:0:17251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd400/0x998c12b283538844 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341752:0:17251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd400/0x998c12b283538844 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341760:0:17251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:0.0:1788832380.341762:0:17251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788832380.341765:0:17251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd400/0x998c12b283538844 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.341769:0:17251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c092dd400/0x998c12b283538844 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832380.341855:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+28:15668:x1875726202705152:12345-192.168.203.26@tcp:34:lhsmtool_posix.0 Request processed in 585us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832380.341863:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 50 00000100:00100000:1.0:1788832380.354957:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832380.356019:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202705408 00000100:00100000:3.0:1788832380.356038:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202705408 00000100:00100000:3.0:1788832380.356238:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:3.0:1788832380.356250:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c1fe24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+28:15668:x1875726202705408:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832380.356272:0:17816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832380.356304:0:17816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204aa00/0x998c12b28353884b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b96 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.356433:0:17816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b283538852 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.356449:0:17816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b283538852 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.356461:0:17816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b283538852 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788832380.356472:0:17816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788832380.356581:0:17816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b283538852 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.356589:0:17816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b283538852 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.356596:0:17816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b283538852 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.356603:0:17816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c4204b000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832380.356608:0:17816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b283538852 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.356616:0:17816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b283538852 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.356652:0:17816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:3.0:1788832380.356656:0:17816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788832380.356661:0:17816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b283538852 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.356678:0:17816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b283538852 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.356723:0:17816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204aa00/0x998c12b28353884b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b96 expref: 30 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.356735:0:17816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d2c1b273800) 00010000:00010000:3.0:1788832380.356737:0:17816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788832380.356741:0:17816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204aa00/0x998c12b28353884b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b96 expref: 30 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.356752:0:17816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c4204aa00, rc 0) 00000100:00100000:3.0:1788832380.356821:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c1fe24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+29:15668:x1875726202705408:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 573us (1878us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1788832380.356829:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 51 00000100:00100000:1.0:1788832380.364528:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832380.364680:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202705536 00000100:00100000:3.0:1788832380.364695:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202705536 00000100:00100000:3.0:1788832380.364773:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:3.0:1788832380.364993:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+29:15668:x1875726202705536:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788832380.365028:0:17251:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788832380.365168:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+29:15668:x1875726202705536:12345-192.168.203.26@tcp:53:lhsmtool_posix.0 Request processed in 181us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832380.365175:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 52 00000100:00100000:1.0:1788832380.371053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832380.371437:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202705792 00000100:00100000:2.0:1788832380.371447:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202705792 00000100:00100000:2.0:1788832380.371506:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:2.0:1788832380.371517:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b067f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+29:15668:x1875726202705792:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788832380.371550:0:17252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832380.371573:0:17252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283538860 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04b9d expref: -99 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788832380.372204:0:17252:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:2.0:1788832380.372211:0:17252:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1788832380.372234:0:17252:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1788832380.372763:0:17252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283538867 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.373331:0:17252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283538867 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.373349:0:17252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283538867 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.373426:0:17252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b283538860 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b9d expref: 32 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.373446:0:17252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283538867 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b9d expref: 31 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.373455:0:17252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d2c1b273200) 00010000:00010000:2.0:1788832380.373469:0:17252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788832380.373473:0:17252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cff200, rc 0) 00000100:00100000:2.0:1788832380.373554:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b067f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+31:15668:x1875726202705792:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 2038us (2511us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788832380.373561:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:1.0:1788832380.380199:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832380.384161:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202706048 00000100:00100000:3.0:1788832380.384176:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202706048 00000100:00100000:3.0:1788832380.385122:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:3.0:1788832380.385153:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+31:15668:x1875726202706048:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788832380.385216:0:17251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832380.385242:0:17251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff200/0x998c12b283538867 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b9d expref: 31 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.385261:0:17251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d2c1b273200) 00010000:00010000:3.0:1788832380.385272:0:17251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788832380.385292:0:17251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204aa00/0x998c12b283538875 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.385307:0:17251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204aa00/0x998c12b283538875 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.385317:0:17251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204aa00/0x998c12b283538875 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.385332:0:17251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b28353887c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xae2925cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.385339:0:17251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b28353887c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xae2925cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.385347:0:17251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b28353887c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xae2925cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.385391:0:17251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204aa00/0x998c12b283538875 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.385399:0:17251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204aa00/0x998c12b283538875 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.385416:0:17251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204aa00/0x998c12b283538875 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.385422:0:17251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c4204aa00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832380.385426:0:17251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204aa00/0x998c12b283538875 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.385434:0:17251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204aa00/0x998c12b283538875 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.385442:0:17251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d2b073ae000) 00010000:00010000:3.0:1788832380.385446:0:17251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832380.385449:0:17251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204aa00/0x998c12b283538875 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.385455:0:17251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204aa00/0x998c12b283538875 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.385465:0:17251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b28353887c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xae2925cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.385471:0:17251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b28353887c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xae2925cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.385476:0:17251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b28353887c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xae2925cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.385480:0:17251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c4204b000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832380.385483:0:17251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b28353887c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xae2925cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.385499:0:17251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b28353887c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xae2925cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.385506:0:17251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xae2925cc (ffff9d2c1fe13600) 00010000:00010000:3.0:1788832380.385509:0:17251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788832380.385511:0:17251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b28353887c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xae2925cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.385518:0:17251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b28353887c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xae2925cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832380.385606:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+30:15668:x1875726202706048:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 457us (5415us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788832380.385614:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 54 00000100:00100000:0.0:1788832380.401071:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832380.401161:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202706176 00000100:00100000:3.0:1788832380.401170:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202706176 00000100:00100000:3.0:1788832380.401232:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:3.0:1788832380.401242:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+30:15668:x1875726202706176:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832380.401260:0:17816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832380.401283:0:17816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a000/0x998c12b283538883 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04ba4 expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.401318:0:17816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204ba00/0x998c12b28353888a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.401331:0:17816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204ba00/0x998c12b28353888a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.401342:0:17816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204ba00/0x998c12b28353888a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.401461:0:17816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a000/0x998c12b283538883 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04ba4 expref: 32 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.401480:0:17816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204ba00/0x998c12b28353888a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04ba4 expref: 31 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.401489:0:17816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d2c1fe13c00) 00010000:00010000:3.0:1788832380.401492:0:17816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788832380.401495:0:17816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c4204ba00, rc 0) 00000100:00100000:3.0:1788832380.401554:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+31:15668:x1875726202706176:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 314us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832380.401562:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 55 00000100:00100000:0.0:1788832380.406429:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832380.408099:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202706432 00000100:00100000:1.0:1788832380.408112:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202706432 00000100:00100000:1.0:1788832380.408187:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:1.0:1788832380.408198:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+31:15668:x1875726202706432:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788832380.408281:0:17253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a600/0x998c12b283538891 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832380.408315:0:17253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a600/0x998c12b283538891 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832380.408327:0:17253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a600/0x998c12b283538891 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788832380.408488:0:17253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1788832380.408497:0:17253:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 520448876123ns, next at 521448873679ns, rc = 0 00000004:00010000:1.0:1788832380.408555:0:17253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077ef7a52 reply state 00000000e339e16a transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a600/0x998c12b283538891 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832380.408568:0:17253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a600/0x998c12b283538891 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832380.408575:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d2c1fe13c00) 00010000:00010000:1.0:1788832380.408578:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788832380.408581:0:17253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788832380.411718:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+33:15668:x1875726202706432:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 3511us (5289us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788832380.411731:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 56 00000100:00100000:1.0:1788832380.415386:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832380.418925:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202706560 00000100:00100000:3.0:1788832380.418940:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202706560 00000100:00100000:3.0:1788832380.419017:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:3.0:1788832380.419027:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+33:15668:x1875726202706560:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788832380.419117:0:17816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832380.419141:0:17816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a000/0x998c12b283538898 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04bab expref: -99 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.419199:0:17816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a000/0x998c12b283538898 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bab expref: 34 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.419215:0:17816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a000/0x998c12b283538898 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bab expref: 34 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.419443:0:17816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d2c1fe13c00) 00010000:00010000:2.0:1788832380.419447:0:17816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788832380.419452:0:17816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c4204a000, rc 0) 00000100:00100000:2.0:1788832380.419519:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fc1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+34:15668:x1875726202706560:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 493us (4141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832380.419526:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 57 00000100:00100000:0.0:1788832380.428551:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832380.428711:0:19717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202706688 00000100:00100000:2.0:1788832380.428722:0:19717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202706688 00000100:00100000:2.0:1788832380.428787:0:19717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:2.0:1788832380.428798:0:19717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:2394:x1875726202706688:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788832380.429271:0:19717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:2394:x1875726202706688:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 472us (737us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788832380.429280:0:19717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:0.0:1788832380.432966:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832380.433130:0:17254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202706944 00000100:00100000:1.0:1788832380.433150:0:17254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202706944 00000100:00100000:1.0:1788832380.433213:0:17254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:1.0:1788832380.433224:0:17254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+34:15668:x1875726202706944:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788832380.433451:0:17254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+35:15668:x1875726202706944:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 228us (495us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788832380.433459:0:17254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 9 00000100:00100000:1.0:1788832380.436230:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832380.436367:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202707200 00000100:00100000:3.0:1788832380.436376:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202707200 00000100:00100000:3.0:1788832380.436429:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:3.0:1788832380.436439:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+35:15668:x1875726202707200:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788832380.436553:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+35:15668:x1875726202707200:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 115us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832380.436560:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 58 00000100:00100000:0.0:1788832380.442128:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832380.443902:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202707328 00000100:00100000:2.0:1788832380.444119:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202707328 00000100:00100000:2.0:1788832380.444248:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:2.0:1788832380.444260:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+35:15668:x1875726202707328:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788832380.444281:0:17252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832380.444300:0:17252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b28353889f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04bb2 expref: -99 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.444372:0:17252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835388a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.444410:0:17252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835388a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.444422:0:17252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835388a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788832380.444705:0:17252:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788832380.444725:0:17252:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835388a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.444750:0:17252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe000/0x998c12b28353889f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bb2 expref: 37 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.444770:0:17252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835388a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bb2 expref: 36 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.444779:0:17252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d2c1fe13c00) 00010000:00010000:2.0:1788832380.444782:0:17252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788832380.444785:0:17252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe800, rc 0) 00000100:00100000:2.0:1788832380.444851:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+36:15668:x1875726202707328:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 593us (2731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832380.444859:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:0.0:1788832380.448203:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832380.451457:0:19715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202707456 00000100:00100000:3.0:1788832380.451472:0:19715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202707456 00000100:00100000:2.0:1788832380.454045:0:19715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:2.0:1788832380.454061:0:19715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:2393:x1875726202707456:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788832380.454079:0:19715:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788832380.454101:0:19715:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b40865f/0x998c12b2835388ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04bb9 expref: -99 pid: 19715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788832380.454147:0:19715:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f6a7c, blocks: 0x0 00010000:00010000:2.0:1788832380.454169:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=520s v=(0 0) 00010000:00010000:2.0:1788832380.454173:0:19715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832380.454182:0:19715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b40865f/0x998c12b2835388ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bb9 expref: 7 pid: 19715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.454202:0:19715:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001b40865f/0x998c12b2835388ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bb9 expref: 7 pid: 19715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.454215:0:19715:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2b07cfe000, rc 0) 00000100:00100000:2.0:1788832380.454288:0:19715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+7:2393:x1875726202707456:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 231us (6093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832380.454295:0:19715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:1.0:1788832380.458183:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832380.458269:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202707712 00000100:00100000:3.0:1788832380.458279:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202707712 00000100:00100000:3.0:1788832380.458504:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:3.0:1788832380.458516:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+36:15668:x1875726202707712:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788832380.458652:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+36:15668:x1875726202707712:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 138us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832380.458659:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 60 00000100:00100000:1.0:1788832380.474987:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832380.475160:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202707840 00000100:00100000:2.0:1788832380.475171:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202707840 00000100:00100000:2.0:1788832380.475245:0:17816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:2.0:1788832380.475256:0:17816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+36:15668:x1875726202707840:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788832380.478923:0:17231:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1788832380.478941:0:17231:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788832380.479156:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c04dc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218504320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788832380.479222:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1788832380.480111:0:17231:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:2.0:1788832380.480551:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050bc00/0x998c12b2835386e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480564:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050bc00/0x998c12b2835386e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480573:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050bc00/0x998c12b2835386e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480598:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c3050bc00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832380.480603:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050bc00/0x998c12b2835386e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480611:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050bc00/0x998c12b2835386e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480649:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d2b073ae100) 00010000:00010000:2.0:1788832380.480653:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832380.480658:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050bc00/0x998c12b2835386e6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480666:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050bc00/0x998c12b2835386e6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480688:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835386ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480695:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835386ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480701:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835386ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480706:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c3050a800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832380.480710:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835386ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480716:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835386ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480735:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d2b073ae000) 00010000:00010000:2.0:1788832380.480738:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832380.480741:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835386ed lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480748:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835386ed lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480762:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283538795 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480769:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283538795 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480775:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283538795 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480781:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cffe00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832380.480784:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283538795 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480790:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283538795 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480798:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9d2c1b273000) 00010000:00010000:2.0:1788832380.480801:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832380.480804:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283538795 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480809:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b283538795 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480837:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b28353881a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480843:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b28353881a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480849:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b28353881a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480855:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfec00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832380.480858:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b28353881a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480865:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b28353881a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480874:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:2.0:1788832380.480876:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832380.480879:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b28353881a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480886:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b28353881a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480898:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a600/0x998c12b283538891 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480904:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a600/0x998c12b283538891 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480910:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a600/0x998c12b283538891 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480921:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c3050a600 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832380.480924:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a600/0x998c12b283538891 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480930:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a600/0x998c12b283538891 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480940:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d2c1fe13c00) 00010000:00010000:2.0:1788832380.480942:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788832380.480945:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a600/0x998c12b283538891 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.480952:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a600/0x998c12b283538891 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832380.481957:0:17816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+15:15668:x1875726202707840:12345-192.168.203.26@tcp:44:lhsmtool_posix.0 Request processed in 6697us (6976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832380.481970:0:17816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 61 00000100:00100000:0.0:1788832380.482035:0:18760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218504320 00000100:00100000:0.0:1788832380.482044:0:18760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218504320 00000100:00100000:0.0:1788832380.482102:0:18760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788832380.482110:0:18760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c38968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218504320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788832380.482226:0:18760:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788832380.482229:0:18760:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788832380.482232:0:18760:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788832380.482234:0:18760:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788832380 -> 1788832380 00002000:00010000:0.0:1788832380.482236:0:18760:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788832380.482288:0:18760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c38968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3654:x1875726218504320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (3067us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788832380.482294:0:18760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:0.0:1788832380.482663:0:3654:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d2c04dc6680/2, rc 0, transno 8589934596 00000100:00100000:0.0:1788832380.482670:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c04dc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218504320:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1788832380.483712:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788832380.487830:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832380.487928:0:19714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202707968 00000100:00100000:3.0:1788832380.487937:0:19714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202707968 00000100:00100000:3.0:1788832380.487996:0:19714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:3.0:1788832380.488007:0:19714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+7:2393:x1875726202707968:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788832380.488112:0:19714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+7:2393:x1875726202707968:12345-192.168.203.26@tcp:16:lhsmtool_posix.0 Request processed in 106us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832380.488119:0:19714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 23 00000100:00100000:1.0:1788832380.490926:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00010000:00010000:0.0:1788832380.491217:0:3638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353873a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.491229:0:3638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353873a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.491237:0:3638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353873a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.491261:0:3638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c421d3000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:0.0:1788832380.491265:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353873a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.491274:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353873a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.491292:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d2b073ae000) 00010000:00010000:0.0:1788832380.491294:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788832380.491300:0:3638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353873a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.491306:0:3638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c421d3000/0x998c12b28353873a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832380.491361:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202708224 00000100:00100000:2.0:1788832380.491372:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202708224 00000100:00100000:2.0:1788832380.491437:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 62 00000100:00100000:2.0:1788832380.491448:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+15:15668:x1875726202708224:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788832380.491498:0:17253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832380.491520:0:17253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfe800/0x998c12b2835388a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bb2 expref: 15 pid: 17252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.491544:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d2c1fe13c00) 00010000:00010000:2.0:1788832380.491549:0:17253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788832380.491578:0:17253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b2835388b4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.491602:0:17253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b2835388b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.491613:0:17253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b2835388b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788832380.491763:0:17253:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000852ff51d reply state 0000000070aeb21a transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b2835388b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.491775:0:17253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff000/0x998c12b2835388b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.491782:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d2c1fe13c00) 00010000:00010000:2.0:1788832380.491784:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788832380.491787:0:17253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788832380.491887:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+16:15668:x1875726202708224:12345-192.168.203.26@tcp:36:lhsmtool_posix.0 Request processed in 440us (979us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788832380.491894:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 62 00000100:00100000:1.0:1788832380.494725:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832380.494841:0:18759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202708352 00000100:00100000:0.0:1788832380.494851:0:18759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202708352 00000100:00100000:0.0:1788832380.494905:0:18759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:0.0:1788832380.495007:0:18759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+7:15668:x1875726202708352:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788832380.495025:0:18759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788832380.495043:0:18759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b2835388bb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04bc0 expref: -99 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.495078:0:18759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b40865f/0x998c12b2835388ad lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bb9 expref: 8 pid: 19715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.495087:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832380.495091:0:18759:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788832380.495110:0:18759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b2835388bb lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bc0 expref: 8 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.495144:0:18759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b40865f/0x998c12b2835388ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bb9 expref: 8 pid: 19715 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.495159:0:18759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b40865f/0x998c12b2835388ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bb9 expref: 8 pid: 19715 timeout: 620 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832380.495175:0:18759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c04dc7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18759:1875726218504448:192.168.203.26@tcp:104: 00000100:00100000:0.0:1788832380.495245:0:18759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b067739c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788832380.500905:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832380.501361:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202708480 00000100:00100000:2.0:1788832380.501372:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202708480 00010000:00010000:2.0:1788832380.501415:0:17236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b40865f/0x998c12b2835388ad lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bb9 expref: 9 pid: 19715 timeout: 620 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832380.501466:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:2.0:1788832380.501476:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+9:2393:x1875726202708480:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788832380.501490:0:17236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788832380.501512:0:17236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b40865f/0x998c12b2835388ad lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bb9 expref: 9 pid: 19715 timeout: 620 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.501553:0:17236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b40865f/0x998c12b2835388ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bb9 expref: 9 pid: 19715 timeout: 620 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.501580:0:17236:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832380.501585:0:17236:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832380.501590:0:17236:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b2835388bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bc0 expref: 9 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.501600:0:17236:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b2835388bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bc0 expref: 9 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.501665:0:17236:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b2835388bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bc0 expref: 9 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832380.501680:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17236:1875726218504576:192.168.203.26@tcp:105: 00000100:00100000:2.0:1788832380.501753:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0fe40 going to sleep for 11 seconds 00010000:00010000:0.0:1788832380.505053:0:18759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b40865f/0x998c12b2835388ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bb9 expref: 9 pid: 19715 timeout: 620 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832380.505081:0:18759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c04dc7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18759:1875726218504448:192.168.203.26@tcp:104: 00010000:00010000:0.0:1788832380.505114:0:18759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b2835388bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bc0 expref: 8 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.505129:0:18759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c092dc200, rc 0) 00000100:00100000:0.0:1788832380.505191:0:18759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+8:15668:x1875726202708352:12345-192.168.203.26@tcp:101:lhsmtool_posix.0 Request processed in 10189us (10476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832380.505201:0:18759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 24 00000100:00100000:0.0:1788832380.506135:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17236:1875726218504576:192.168.203.26@tcp:105: 00010000:00010000:0.0:1788832380.506151:0:17236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832380.506195:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+7:2393:x1875726202708480:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 4721us (5298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832380.506203:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 19 00000100:00100000:1.0:1788832380.509512:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832380.509650:0:18760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202708608 00000100:00100000:0.0:1788832380.509660:0:18760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202708608 00000100:00100000:0.0:1788832380.509715:0:18760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:0.0:1788832380.509725:0:18760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+7:2394:x1875726202708608:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788832380.509880:0:18760:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788832380.509883:0:18760:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788832380 00002000:00010000:0.0:1788832380.509886:0:18760:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788832379 00002000:00010000:0.0:1788832380.509888:0:18760:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788832380 -> 1788832380 00002000:00010000:0.0:1788832380.509890:0:18760:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788832380.518779:0:18760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+8:2394:x1875726202708608:12345-192.168.203.26@tcp:2:lhsmtool_posix.0 Request processed in 9042us (9262us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788832380.518795:0:18760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:1.0:1788832380.528344:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832380.528478:0:19717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202708736 00000100:00100000:2.0:1788832380.528488:0:19717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202708736 00000100:00100000:2.0:1788832380.528557:0:19717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:2.0:1788832380.528568:0:19717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+8:2393:x1875726202708736:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788832380.528611:0:19717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b2835388c2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.528680:0:19717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b2835388bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bc0 expref: 8 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.528895:0:19717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832380.528899:0:19717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788832380.528904:0:19717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b2835388c2 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.528938:0:19717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b2835388bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bc0 expref: 8 pid: 18759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.528953:0:19717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b2835388bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bc0 expref: 8 pid: 18759 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832380.528968:0:19717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:19717:1875726218504704:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788832380.529037:0:19717:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788832380.532028:0:19717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:19717:1875726218504704:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832380.532055:0:19717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b2835388c2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788832380.533789:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832380.533930:0:17238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202708864 00000100:00100000:3.0:1788832380.533952:0:17238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202708864 00010000:00010000:3.0:1788832380.533988:0:17238:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b2835388bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bc0 expref: 9 pid: 18759 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832380.534031:0:17238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 20 00000100:00100000:3.0:1788832380.534040:0:17238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+9:2394:x1875726202708864:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832380.534053:0:17238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832380.534071:0:17238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b2835388bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bc0 expref: 9 pid: 18759 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.534082:0:17238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b2835388bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bc0 expref: 9 pid: 18759 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.534099:0:17238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbe98b6f/0x998c12b2835388bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bc0 expref: 9 pid: 18759 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.534112:0:17238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788832380.534115:0:17238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788832380.534119:0:17238:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b2835388c2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.534125:0:17238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b2835388c2 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.534158:0:17238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832380.534210:0:17238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+8:2394:x1875726202708864:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 170us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832380.534228:0:17238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 20 00010000:00010000:0.0:1788832380.534503:0:19717:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b2835388c2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.534514:0:19717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b2835388c2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.534545:0:19717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b2835388c2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.534554:0:19717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b2835388c2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.534563:0:19717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b2835388c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.534581:0:19717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfe800 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:0.0:1788832380.534586:0:19717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b2835388c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.534595:0:19717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b2835388c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.534607:0:19717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b2835388c2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.534615:0:19717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d345b13/0x998c12b2835388c2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832380.534714:0:19717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+7:2393:x1875726202708736:12345-192.168.203.26@tcp:1:lhsmtool_posix.0 Request processed in 6147us (6378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832380.534722:0:19717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:1.0:1788832380.538033:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832380.538110:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202709120 00000100:00100000:3.0:1788832380.538120:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202709120 00000100:00100000:3.0:1788832380.538190:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 63 00000100:00100000:3.0:1788832380.538200:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+16:15668:x1875726202709120:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788832380.538290:0:17252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b2835388c9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.538314:0:17252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b400/0x998c12b283538813 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b81 expref: 16 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.538325:0:17252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b2835388c9 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.538360:0:17252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b400/0x998c12b283538813 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b81 expref: 16 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.538373:0:17252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b400/0x998c12b283538813 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b81 expref: 16 pid: 17251 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832380.538386:0:17252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07ddd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17252:1875726218504832:192.168.203.26@tcp:104: 00000100:00100000:3.0:1788832380.538463:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c087e2780 going to sleep for 11 seconds 00000100:00100000:3.0:1788832380.541347:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832380.541428:0:17252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07ddd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17252:1875726218504832:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832380.541449:0:17252:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b2835388c9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832380.541513:0:17236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202709248 00000100:00100000:0.0:1788832380.541519:0:17236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202709248 00010000:00010000:0.0:1788832380.541560:0:17236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b400/0x998c12b283538813 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b81 expref: 17 pid: 17251 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788832380.541596:0:17236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 21 00000100:00100000:0.0:1788832380.541606:0:17236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+17:2394:x1875726202709248:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788832380.541647:0:17236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788832380.541662:0:17236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b400/0x998c12b283538813 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b81 expref: 17 pid: 17251 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.541673:0:17236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b400/0x998c12b283538813 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b81 expref: 17 pid: 17251 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.541694:0:17236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b400/0x998c12b283538813 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b81 expref: 17 pid: 17251 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.541709:0:17236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:0.0:1788832380.541715:0:17236:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353882f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b8f expref: 16 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.541724:0:17236:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b2835388c9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.541731:0:17236:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b2835388c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.541738:0:17236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b2835388c9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.541807:0:17236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788832380.541858:0:17236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+16:2394:x1875726202709248:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 253us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832380.541866:0:17236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 21 00010000:00010000:2.0:1788832380.543023:0:17252:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b2835388c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.543037:0:17252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b2835388c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.543481:0:17252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835388d0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.543497:0:17252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a000/0x998c12b283538898 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bab expref: 16 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.543507:0:17252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835388d0 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.543550:0:17252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a000/0x998c12b283538898 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bab expref: 16 pid: 17816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.543565:0:17252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a000/0x998c12b283538898 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bab expref: 16 pid: 17816 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832380.543580:0:17252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17252:1875726218504960:192.168.203.26@tcp:104: 00000100:00100000:2.0:1788832380.543889:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788832380.547885:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832380.548219:0:17252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17252:1875726218504960:192.168.203.26@tcp:104: 00010000:00010000:2.0:1788832380.548246:0:17252:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835388d0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832380.548449:0:17237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202709376 00000100:00100000:3.0:1788832380.548455:0:17237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202709376 00010000:00010000:3.0:1788832380.548488:0:17237:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a000/0x998c12b283538898 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bab expref: 17 pid: 17816 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832380.548581:0:17237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 22 00000100:00100000:3.0:1788832380.548591:0:17237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+17:2394:x1875726202709376:12345-192.168.203.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788832380.548606:0:17237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788832380.548612:0:17237:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a000/0x998c12b283538898 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bab expref: 17 pid: 17816 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.548642:0:17237:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a000/0x998c12b283538898 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bab expref: 17 pid: 17816 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.548665:0:17237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a000/0x998c12b283538898 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bab expref: 17 pid: 17816 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.548679:0:17237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d2c1fe13c00) 00010000:00010000:3.0:1788832380.548684:0:17237:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835388d0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.548693:0:17237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835388d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.548701:0:17237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835388d0 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.548727:0:17237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788832380.548788:0:17237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+16:2394:x1875726202709376:12345-192.168.203.26@tcp:103:ldlm_bl.0 Request processed in 197us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832380.548795:0:17237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 22 00010000:00010000:2.0:1788832380.549850:0:17252:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835388d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.549871:0:17252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835388d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788832380.549972:0:17252:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788832380.550083:0:17252:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788832380.550115:0:17252:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788832380.550209:0:17252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17252:1875726218505088:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788832380.550275:0:17252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832380.550315:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2b06589f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788832380.550551:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218505088 00000100:00100000:1.0:1788832380.550557:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218505088 00000100:00100000:1.0:1788832380.550605:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788832380.550614:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17252:x1875726218505088:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788832380.550726:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17252:x1875726218505088:12345-0@lo:1000:mdt00_001.0 Request processed in 112us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832380.550734:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788832380.550899:0:17252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17252:1875726218505088:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788832380.551047:0:17252:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788832380.551092:0:17252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17252:1875726218505216:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788832380.551121:0:17252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788832380.551371:0:17257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218505216 00000100:00100000:2.0:1788832380.551376:0:17257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218505216 00000100:00100000:2.0:1788832380.551446:0:17257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788832380.551454:0:17257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17252:x1875726218505216:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788832380.551565:0:17257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17252:x1875726218505216:12345-0@lo:1000:mdt00_001.0 Request processed in 111us (443us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788832380.551573:0:17257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788832380.551804:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c3fc0fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788832380.551836:0:17252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17252:1875726218505216:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788832380.551870:0:17252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835388d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.551880:0:17252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835388d0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.551888:0:17252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835388d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.551895:0:17252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cfec00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832380.551899:0:17252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835388d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.551907:0:17252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835388d0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.551922:0:17252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d2c1fe13c00) 00010000:00010000:3.0:1788832380.551924:0:17252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788832380.551928:0:17252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835388d0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.551933:0:17252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cfec00/0x998c12b2835388d0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.551962:0:17252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a800/0x998c12b283538828 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.551967:0:17252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a800/0x998c12b283538828 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.551972:0:17252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a800/0x998c12b283538828 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.551982:0:17252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c4204a800 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:3.0:1788832380.551985:0:17252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a800/0x998c12b283538828 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.551992:0:17252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a800/0x998c12b283538828 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.552000:0:17252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:3.0:1788832380.552003:0:17252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788832380.552009:0:17252:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353882f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b8f expref: 19 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.552033:0:17252:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353882f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b8f expref: 19 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.552043:0:17252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353882f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b8f expref: 19 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.552095:0:17252:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cff800/0x998c12b28353882f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04b8f expref: 19 pid: 17253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788832380.552107:0:17252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07dddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17252:1875726218505344:192.168.203.26@tcp:105: 00000100:00100000:3.0:1788832380.552200:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff9d2c087e2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788832380.556607:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1788832380.556760:0:17254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202709504 00000100:00100000:1.0:1788832380.556769:0:17254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202709504 00000100:00100000:1.0:1788832380.556898:0:17254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:1.0:1788832380.556908:0:17254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0768bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+20:15667:x1875726202709504:12345-192.168.203.26@tcp:49:dd.0 00000100:00100000:1.0:1788832380.557078:0:17254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0768bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+20:15667:x1875726202709504:12345-192.168.203.26@tcp:49:dd.0 Request processed in 169us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832380.557101:0:17254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 10 00000100:00100000:3.0:1788832380.557315:0:17252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07dddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17252:1875726218505344:192.168.203.26@tcp:105: 00010000:00010000:3.0:1788832380.557339:0:17252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a800/0x998c12b283538828 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.557360:0:17252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204a800/0x998c12b283538828 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.557545:0:17252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835388d7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.557559:0:17252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835388d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.557572:0:17252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835388d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.557587:0:17252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835388d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.557594:0:17252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835388d7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.557601:0:17252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835388d7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.557606:0:17252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cffe00 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832380.557610:0:17252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835388d7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.557725:0:17252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835388d7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.557741:0:17252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:2.0:1788832380.557744:0:17252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788832380.557748:0:17252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835388d7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.557753:0:17252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2b07cffe00/0x998c12b2835388d7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.557763:0:17252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b2835388c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.557769:0:17252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b2835388c9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.557849:0:17252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b2835388c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.557862:0:17252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c4204b000 already unused, calling callback (ffffffffc1a1f4f0) 00010000:00010000:2.0:1788832380.557866:0:17252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b2835388c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.557871:0:17252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b2835388c9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.557879:0:17252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:2.0:1788832380.557881:0:17252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788832380.557884:0:17252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b2835388c9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.557889:0:17252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204b000/0x998c12b2835388c9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832380.558066:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+19:15668:x1875726202709120:12345-192.168.203.26@tcp:57:lhsmtool_posix.0 Request processed in 19866us (20042us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788832380.558075:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 63 00000020:00080000:2.0:1788832380.558079:0:17252:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788832380.562820:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832380.562879:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832380.563008:0:17251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202709888 00000100:00100000:3.0:1788832380.563017:0:17251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202709888 00000100:00100000:3.0:1788832380.563075:0:17251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:3.0:1788832380.563085:0:17251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+19:15667:x1875726202709888:12345-192.168.203.26@tcp:101:dd.0 00010000:00010000:3.0:1788832380.563109:0:17251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788832380.563130:0:17251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204aa00/0x998c12b2835388de lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dd88ec75bc04bc7 expref: -99 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.563180:0:17251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204ac00/0x998c12b2835388e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.563195:0:17251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204ac00/0x998c12b2835388e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.563206:0:17251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204ac00/0x998c12b2835388e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17251 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.563326:0:17251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204aa00/0x998c12b2835388de lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bc7 expref: 21 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.563345:0:17251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c4204ac00/0x998c12b2835388e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0x4dd88ec75bc04bc7 expref: 20 pid: 17251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.563353:0:17251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d2c1b273100) 00010000:00010000:3.0:1788832380.563356:0:17251:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788832380.563366:0:17251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d2c4204ac00, rc 0) 00000100:00100000:3.0:1788832380.563420:0:17251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+20:15667:x1875726202709888:12345-192.168.203.26@tcp:101:dd.0 Request processed in 337us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832380.563427:0:17251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 64 00000100:00100000:1.0:1788832380.563725:0:17254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202709760 00000100:00100000:1.0:1788832380.563731:0:17254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202709760 00000100:00100000:1.0:1788832380.563770:0:17254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 11 00000100:00100000:1.0:1788832380.563785:0:17254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+20:15668:x1875726202709760:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788832380.563997:0:17254:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788832380.564026:0:17254:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1788832380.564050:0:17254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835388ec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832380.564060:0:17254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835388ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832380.564068:0:17254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835388ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832380.564075:0:17254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835388ec lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832380.564080:0:17254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835388ec lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832380.564085:0:17254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835388ec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832380.564101:0:17254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788832380.564132:0:17239:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788832380.564137:0:17239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835388ec lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832380.564156:0:17239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c3050a800 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:1.0:1788832380.564177:0:17239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835388ec lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832380.564186:0:17239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835388ec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832380.564197:0:17239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d2c1fe13c00) 00010000:00010000:1.0:1788832380.564199:0:17239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788832380.564203:0:17239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835388ec lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832380.564209:0:17239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d2c3050a800/0x998c12b2835388ec lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788832380.564219:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832380.564221:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832380.564223:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788832380.564277:0:17254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+22:15668:x1875726202709760:12345-192.168.203.26@tcp:35:lhsmtool_posix.0 Request processed in 492us (1466us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1788832380.564285:0:17254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 11 00000020:00080000:1.0:1788832380.564289:0:17254:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1788832380.566183:0:17287:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788832380.566191:0:17287:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788832380.566231:0:17287:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788832380.566240:0:17287:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788832380.631059:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c04dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218505728:0@lo:400:kworker.0 00000100:00100000:0.0:1788832380.631130:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832380.631186:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c04dc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218506240:0@lo:400:kworker.0 00000100:00100000:0.0:1788832380.631212:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832380.631228:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218506752:0@lo:400:kworker.0 00000100:00100000:0.0:1788832380.631260:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832380.631285:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788832380.631291:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c04dc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218505856:0@lo:400:kworker.0 00000100:00100000:0.0:1788832380.631312:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832380.631328:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c04dc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218506368:0@lo:400:kworker.0 00000100:00100000:0.0:1788832380.631348:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832380.631362:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218506880:0@lo:400:kworker.0 00000100:00100000:0.0:1788832380.631380:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832380.631408:0:18308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218505728 00000100:00100000:0.0:1788832380.631415:0:18308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218505728 00000100:00100000:0.0:1788832380.631457:0:18308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788832380.631466:0:18308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218505728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832380.631518:0:18308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218505728:12345-0@lo:400:kworker.0 Request processed in 52us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832380.631526:0:18308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788832380.631667:0:18759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218506240 00000100:00100000:0.0:1788832380.631671:0:18759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218506240 00000100:00100000:0.0:1788832380.631707:0:18759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218505856 00000100:00100000:0.0:1788832380.631710:0:18759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218505856 00000100:00100000:0.0:1788832380.631729:0:18759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788832380.631735:0:18759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218506240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832380.631778:0:18759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1875726218506240:12345-0@lo:400:kworker.0 Request processed in 43us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832380.631784:0:18759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788832380.631796:0:18759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788832380.631802:0:18759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218505856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832380.631830:0:18759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218505856:12345-0@lo:400:kworker.0 Request processed in 28us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832380.631835:0:18759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788832380.631851:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788832380.631854:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788832380.631882:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c04dc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218505856:0@lo:400:kworker.0 00000100:00100000:0.0:1788832380.631894:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c04dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218505728:0@lo:400:kworker.0 00000100:00100000:0.0:1788832380.631902:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c04dc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1875726218506240:0@lo:400:kworker.0 00000100:00100000:0.0:1788832380.631927:0:17816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218506752 00000100:00100000:0.0:1788832380.631931:0:17816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218506752 00000100:00080000:0.0:1788832380.631945:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832380.631969:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218506368 00000100:00100000:0.0:1788832380.631972:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218506368 00000100:00100000:0.0:1788832380.631984:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218506880 00000100:00100000:0.0:1788832380.631986:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218506880 00000100:00100000:0.0:1788832380.632003:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788832380.632009:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b0756d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218506752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832380.632044:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b0756d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1875726218506752:12345-0@lo:400:kworker.0 Request processed in 34us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832380.632049:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788832380.632060:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788832380.632073:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218506368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832380.632103:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1875726218506368:12345-0@lo:400:kworker.0 Request processed in 31us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832380.632109:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788832380.632119:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788832380.632125:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b06611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218506880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832380.632149:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b06611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1875726218506880:12345-0@lo:400:kworker.0 Request processed in 25us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832380.632155:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788832380.632167:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788832380.632182:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c04dc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1875726218506368:0@lo:400:kworker.0 00010000:00080000:0.0:1788832380.632194:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2b07f34a80 x1875726218506880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788832380.632204:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1875726218506880:0@lo:400:kworker.0 00000100:00100000:0.0:1788832380.632213:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1875726218506752:0@lo:400:kworker.0 00000100:00100000:3.0:1788832380.632667:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c04dc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e119a26-e2c8-49b5-8e81-f568246f48a1:3652:1875726218505600:0@lo:400:kworker.0 00000100:00100000:3.0:1788832380.632708:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832380.632739:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c04dc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218506112:0@lo:400:kworker.0 00000100:00100000:3.0:1788832380.632761:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832380.632791:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1875726218506624:0@lo:400:kworker.0 00000100:00100000:3.0:1788832380.632811:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832380.632831:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788832380.632837:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b077a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218505472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788832380.632860:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832380.632877:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c04dc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875726218505984:0@lo:400:kworker.0 00000100:00100000:3.0:1788832380.632896:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832380.632913:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c04dc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1875726218506496:0@lo:400:kworker.0 00000100:00100000:3.0:1788832380.632931:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788832380.632953:0:18761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218505472 00000100:00100000:3.0:1788832380.632957:0:18761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218505472 00000100:00100000:3.0:1788832380.632989:0:18761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788832380.632997:0:18761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218505472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788832380.633019:0:18761:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788832380.633058:0:18761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218505472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832380.633064:0:18761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788832380.633095:0:17257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218506112 00000100:00100000:3.0:1788832380.633099:0:17257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218506112 00000100:00100000:3.0:1788832380.633122:0:17257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788832380.633141:0:17257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218506112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832380.633280:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218506624 00000100:00100000:2.0:1788832380.633286:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218506624 00000100:00080000:2.0:1788832380.633305:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788832380.633323:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218505984 00000100:00100000:2.0:1788832380.633326:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218505984 00000100:00100000:2.0:1788832380.633334:0:17252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218506496 00000100:00100000:2.0:1788832380.633336:0:17252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218506496 00000100:00080000:2.0:1788832380.633356:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788832380.633373:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788832380.633379:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875726218506624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788832380.633469:0:17244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218505600 00000100:00100000:0.0:1788832380.633472:0:17244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218505600 00000100:00100000:0.0:1788832380.633500:0:17244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788832380.633506:0:17244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:3652:x1875726218505600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788832380.633612:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218507008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788832380.635727:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1875726218506624:12345-0@lo:400:kworker.0 Request processed in 2342us (2908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832380.635739:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788832380.635769:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788832380.635875:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875726218505984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832380.635918:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1875726218505984:12345-0@lo:400:kworker.0 Request processed in 49us (3021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832380.635923:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788832380.635934:0:17252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788832380.635940:0:17252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b07ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875726218506496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788832380.635962:0:17252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1875726218506496:12345-0@lo:400:kworker.0 Request processed in 23us (3030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832380.635967:0:17252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788832380.636148:0:17244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e119a26-e2c8-49b5-8e81-f568246f48a1+24:3652:x1875726218505600:12345-0@lo:400:kworker.0 Request processed in 2640us (3437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832380.636157:0:17244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788832380.636468:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2c3fd0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218507264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788832380.636506:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832380.636637:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832380.636665:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788832380.636672:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b06612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218507136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788832380.636695:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788832380.636733:0:18762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218507264 00000100:00100000:1.0:1788832380.636753:0:18762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218507264 00000100:00100000:1.0:1788832380.636791:0:18762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218507136 00000100:00100000:1.0:1788832380.636794:0:18762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218507136 00000100:00100000:1.0:1788832380.636809:0:18762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788832380.636816:0:18762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218507264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788832380.636831:0:18762:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788832380.637000:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9d2b07f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218507392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788832380.637032:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788832380.637078:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218507008 00000100:00100000:0.0:1788832380.637082:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218507008 00000100:00100000:0.0:1788832380.637099:0:17256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726218507392 00000100:00100000:0.0:1788832380.637102:0:17256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726218507392 00000100:00100000:0.0:1788832380.637115:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788832380.637121:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c3fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1875726218507008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788832380.637169:0:17256:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788832380.637206:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c3fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3651:x1875726218507008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832380.637212:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788832380.637225:0:17256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788832380.637231:0:17256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218507392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788832380.637246:0:17256:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788832380.637450:0:17256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1875726218507392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 218us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832380.637456:0:17256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788832380.637493:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b07f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1875726218507392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788832380.637532:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1875726218507008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788832380.637724:0:17257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b07dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1875726218506112:12345-0@lo:400:kworker.0 Request processed in 4594us (4959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832380.637733:0:17257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788832380.637851:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b077a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218505472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788832380.637867:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c04dc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1875726218505984:0@lo:400:kworker.0 00000100:00100000:3.0:1788832380.637877:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c04dc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1875726218506496:0@lo:400:kworker.0 00000100:00100000:3.0:1788832380.637886:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c04dc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e119a26-e2c8-49b5-8e81-f568246f48a1:3652:1875726218505600:0@lo:400:kworker.0 00000100:00100000:3.0:1788832380.637894:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c04dc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1875726218506112:0@lo:400:kworker.0 00010000:00080000:3.0:1788832380.637908:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d2c3fd0c380 x1875726218506624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788832396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788832380.637918:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1875726218506624:0@lo:400:kworker.0 00000100:00100000:1.0:1788832380.638001:0:18762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1875726218507264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1185us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788832380.638009:0:18762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788832380.638087:0:18762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788832380.638097:0:18762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c36d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875726218507136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788832380.638111:0:18762:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788832380.638318:0:18762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c36d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1875726218507136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832380.638327:0:18762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788832380.638404:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2b06612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1875726218507136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788832380.638477:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9d2c3fd0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1875726218507264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788832380.712075:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1788832380.712124:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1788832380.712296:0:18764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202710144 00000100:00100000:3.0:1788832380.712306:0:18764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202710144 00000100:00100000:3.0:1788832380.712366:0:18764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202710016 00000100:00100000:3.0:1788832380.712374:0:18764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202710016 00000100:00100000:3.0:1788832380.712398:0:18764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:3.0:1788832380.712407:0:18764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+8:2396:x1875726202710144:12345-192.168.203.26@tcp:4:dd.0 00002000:00010000:3.0:1788832380.712453:0:18764:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9f6a7c, atime: 0x6a9f6a7b, ctime: 0x6a9f6a7c, blocks: 0x0 00010000:00010000:3.0:1788832380.712462:0:18764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008aae4d37/0x998c12b2835388f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.712488:0:18764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=520s v=(0 0) 00010000:00010000:3.0:1788832380.712492:0:18764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788832380.712499:0:18764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008aae4d37/0x998c12b2835388f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788832380.712514:0:18764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008aae4d37/0x998c12b2835388f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788832380.792789:0:19571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1788832380.792812:0:19571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1788832380.794362:0:18764:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1788832380.794371:0:18764:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788832380 -> 1788832381 00002000:00010000:2.0:1788832380.794373:0:18764:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788832380 -> 1788832381 00002000:00010000:2.0:1788832380.794376:0:18764:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:2.0:1788832380.794395:0:18764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008aae4d37/0x998c12b2835388f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.794432:0:18764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008aae4d37/0x998c12b2835388f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.794441:0:18764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008aae4d37/0x998c12b2835388f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.794448:0:18764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2c4204aa00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832380.794453:0:18764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008aae4d37/0x998c12b2835388f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.794462:0:18764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008aae4d37/0x998c12b2835388f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.794483:0:18764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008aae4d37/0x998c12b2835388f3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.794491:0:18764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008aae4d37/0x998c12b2835388f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832380.794777:0:18764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+6:2396:x1875726202710144:12345-192.168.203.26@tcp:4:dd.0 Request processed in 82363us (82703us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788832380.794794:0:18764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 0 00000100:00100000:2.0:1788832380.794828:0:18764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1 00000100:00100000:2.0:1788832380.794840:0:18764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2c04dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:2396:x1875726202710016:12345-192.168.203.26@tcp:4:dd.0 00002000:00010000:2.0:1788832380.794879:0:18764:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 7654321, mtime: 0x6a9f6a7d, atime: 0x6a9f6a7b, ctime: 0x6a9f6a7d, blocks: 0x1a68 00010000:00010000:2.0:1788832380.794896:0:18764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008649b612/0x998c12b2835388fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.794907:0:18764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=520s v=(0 0) 00010000:00010000:2.0:1788832380.794911:0:18764:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788832380.794917:0:18764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008649b612/0x998c12b2835388fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.794929:0:18764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008649b612/0x998c12b2835388fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788832380.824007:0:20282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788832380.875845:0:19571:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1788832380.876067:0:18764:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1788832380.876085:0:18764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008649b612/0x998c12b2835388fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.876097:0:18764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008649b612/0x998c12b2835388fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.876106:0:18764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008649b612/0x998c12b2835388fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.876114:0:18764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d2b07cffe00 already unused, calling callback (ffffffffc0e1d370) 00010000:00010000:2.0:1788832380.876119:0:18764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008649b612/0x998c12b2835388fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.876139:0:18764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008649b612/0x998c12b2835388fa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.876279:0:18764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008649b612/0x998c12b2835388fa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788832380.876288:0:18764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008649b612/0x998c12b2835388fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788832380.876508:0:18764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2c04dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:2396:x1875726202710016:12345-192.168.203.26@tcp:4:dd.0 Request processed in 81666us (164378us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788832380.876520:0:18764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1 00000040:00080000:2.0:1788832381.655468:0:18007:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788832381.846772:0:17240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788832382.617886:0:20432:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788832382.871798:0:19721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788832383.894899:0:17239:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788832384.215213:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832384.215382:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832384.215402:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832384.215423:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832384.215448:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832384.215471:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832384.215488:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832384.215506:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832384.215539:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1788832384.215573:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202710400 00000100:00100000:2.0:1788832384.215582:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202710400 00000100:00100000:2.0:1788832384.215650:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202710912 00000100:00100000:2.0:1788832384.215653:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202710912 00000100:00100000:2.0:1788832384.215666:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202710528 00000100:00100000:2.0:1788832384.215668:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202710528 00000100:00100000:2.0:1788832384.215681:0:17253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202711040 00000100:00100000:2.0:1788832384.215683:0:17253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202711040 00000100:00100000:2.0:1788832384.215712:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:2.0:1788832384.215721:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+22:2396:x1875726202710400:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832384.215796:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+22:2396:x1875726202710400:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 75us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832384.215803:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 66 00000100:00100000:2.0:1788832384.215821:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:2.0:1788832384.215827:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:2396:x1875726202710912:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832384.215851:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+6:2396:x1875726202710912:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 25us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832384.215857:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 67 00000100:00100000:2.0:1788832384.215868:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:2.0:1788832384.215874:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:2396:x1875726202710528:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832384.215893:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:2396:x1875726202710528:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 20us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832384.215899:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 68 00000100:00100000:2.0:1788832384.215909:0:17253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:2.0:1788832384.215915:0:17253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+5:2396:x1875726202711040:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832384.215935:0:17253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+5:2396:x1875726202711040:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 20us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832384.215941:0:17253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 69 00000100:00100000:2.0:1788832384.215958:0:19717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202710656 00000100:00100000:2.0:1788832384.215961:0:19717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202710656 00000100:00100000:2.0:1788832384.215983:0:19717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202711168 00000100:00100000:2.0:1788832384.215986:0:19717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202711168 00000100:00100000:2.0:1788832384.216009:0:19717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202710784 00000100:00100000:2.0:1788832384.216012:0:19717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202710784 00000100:00100000:2.0:1788832384.216022:0:19717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202711296 00000100:00100000:2.0:1788832384.216024:0:19717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202711296 00000100:00100000:2.0:1788832384.216035:0:19717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:2.0:1788832384.216042:0:19717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:2396:x1875726202710656:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832384.216070:0:19717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:2396:x1875726202710656:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 28us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832384.216077:0:19717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 25 00000100:00100000:2.0:1788832384.216088:0:19717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:2.0:1788832384.216094:0:19717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+5:2396:x1875726202711168:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832384.216221:0:19714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00100000:3.0:1788832384.216241:0:19714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:2396:x1875726202710784:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:0.0:1788832384.216371:0:18758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:0.0:1788832384.216381:0:18758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b077a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+5:2396:x1875726202711296:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:2.0:1788832384.216427:0:19717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+5:2396:x1875726202711168:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 332us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832384.216434:0:19717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 26 00000100:00100000:2.0:1788832384.216455:0:17243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875726202710272 00000100:00100000:2.0:1788832384.216459:0:17243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875726202710272 00000100:00100000:2.0:1788832384.216487:0:17243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 167 00000100:00100000:2.0:1788832384.216494:0:17243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d2b075ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:2396:x1875726202710272:12345-192.168.203.26@tcp:400:kworker.0 00000100:00100000:3.0:1788832384.217789:0:19714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:73b2bbc4-d88c-47e1-9bb5-22ce7d03d3be+5:2396:x1875726202710784:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 1542us (2291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788832384.217800:0:19714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 27 00000100:00080000:3.0:1788832384.217890:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788832384.217895:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788832384.217899:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788832384.217902:0:17246:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788832384.219703:0:18758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b077a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25d19dc9-bcf5-4e5e-99ff-d6d53f235ab6+5:2396:x1875726202711296:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 3314us (4152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788832384.219715:0:18758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 28 00000100:00100000:2.0:1788832384.223808:0:17243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d2b075ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c60bc5a8-bbb2-46ad-b3a5-a8b9a8f404a0+13:2396:x1875726202710272:12345-192.168.203.26@tcp:400:kworker.0 Request processed in 7303us (8346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788832384.223822:0:17243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 167 Debug log: 42098 lines, 42098 kept, 0 dropped, 0 bad.